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ABSTRACT 

The. Bilingual Pupil Services Project 'is a 
compensatory education program that aims to improve .achievement in 
English reading, Spanish reading, and mathematics among Spanish 
speaking students of limited English prof iciency . In 1981-82, thfe 
ptogram;;served 1 , 369 elementary' school students in New York City. To 
accomplish its goals, the program trained 57 paraprof essiorials fqr 
bilingual reading and. mathematics instruction, developed classroom 
curricula, and recruited parent involvement in the program. 
Evaluation of the "project indicated that (1) at all grade levels, 
students in the program demonstrated significant achievement gains in 
English, Spanish, and mathematics ; (2) p?f tic ipants attendance rates 
were high; (3) thte paraprof essionals rated the program very highly; 
and (4) involvement in the program allowed 28 percent of the 
paraprof essionals to receive their baccalaureate degree. It was 
recommended by the evaluators «that a new .testing program be used in 
evaluation 1 and that the paraprof 6ssional training program be reviewed 
to determine its adequacy. This report * includes appendices of 
materials used in project implementation and evaluation. (MJL*) 
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A SUMMARY OF THE EVALUATION 
FOR THE 

BILfNGUAL PUPIL SERVICES PROJECT 
1981-1982 

* m ' 

The Bilingual Pupil Services project (B.P.S.) , funded by E.S.'E.A. Title I, 
provided basic services to 1,869 Spanish-speaking students" of limited English 
proficiency. These students were enrolled in 24 schools in 14 community school 
districts in the boroughs of Manhattan, the Bronx, and Brooklyn* The main pur- 
pose of the program was ^9 iipprove student achievement in the, areas of English 
reading, Spanish reading/and mathematics. 

* In order to accomplish its goal the project recruited, trained, placed, and 
supervised 57 paraprofessional s. This' was accomplished by iL^£entral staff of 
one project director, an assistant project director, four fietd instructional 
specialists, and a number of^support and clerical staff. The staff maintained 
close cooperation and coordination with school and di strict -staff who also 
provided services to the eligible students.^ ; 

The project had. a well developed and* clearly articulated system for selec- 
tion, training, and, supervision of paraprofe'ssi'onals. They were in constant 
'contact with the^ field instructional specialists and received training at the 
school site, their central office, and through college coursework. Close 
records of the training and supervision were maintained by all staff. In fact, 
in the opinion of the evaluator, the sound management system with clearly 
articulated expectations and thorough record keeping may be the cornerstone 
which has contributed 'to the success of the B.P.S; project. 

In all areas of the curriculum English, Spanish, and mathematics -- and 
at all grade levels, students with a full year of instruction demonstrated 
statistically significant gains in tests of reading in English, and Spanish and 
in mathematics. These gains have been consistent for the past three'years. 
However,- problems of test adequacy hav£ persisted. In 1982-83 the project in- 
tends to institute a*new testing program in response to the previous year's 
evaluation report recommendation. r 

Students exhibited excellent attendance rates ranging from a low of 87 
percent at the first grade to a hi§h of 90 percent attendance at* the stath. 

A questionnaire administered to 57 project paraprofessionals in May, 1982 
indicated that the majority were females of Puerto Riqan background. Sixty- 
seven percent were over 31 years old. Paraprofessionals gave very high -ratings 
(ranging between good and excellent) to all programmatic and training aspects 
of the project. Hpwever, analyses indicate that the project should review .the 
adequacy of fehe training fbr participants who are expecting to receive their , 
teaching license in the near future. Overall, 88 percent rated the quality, • 
of the B.P.S. project as Excellent, 11 and all who responded would like to re- 
main in the pjogram. , 



During 1981-82, 16 (or 28 percent) of the participating paraprofessiohals 
received their baccalaureate degree as a result of their participation in the 
project. Based og the project's' previous placement record, the B.P.S. project 
director ant ici Rites that at least fifteen graduates will be appointed as 
teachers. .Since the inception of the B.P.S. project in 1972, 782 paraprofes- 
sionals have earned their baccalaureate degree and themajority entered the 
teaching profession. 
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INTRODUCTION 
\/ 

The Bilingual PupH-SSrvices (B.P.S.) project was funded for fiscal year 
1981-82 as a continuation grant under the provision of<the Elementary and 
Secondary Education Act-Title I. This period completes the eighth cycle for . * 

\ 

which the program has been funded. y The B.P.S. project is a direct service v 

S 

project serving a disadvantaged bilingual student population. It operates 
within the Office qf Bilingual Education (O.B.E.) of the New York City Public 
Schools. 'The project's primary goa,l has been to enhance the academic prog- 
ress and linguistic skills of Title I eligible Hispanic pupils of limited * 

9 

English proficiency.. During the 1981-82 school year, the B.P.S. project 

offered bilingual instructional and supportive services to 1,369 Hispanic LEP 

Students in grades one to s\x. Student eligibility was determined by achieve- 

foent of at least one year below grade level, in Spanish reading and mathematics, 

and a score below the twenty-first percentile on the Language Assessment Battery 
(LAB). 



Program personnel /consisting of six professionals, provided fifty-sev/n 
paraprofessional s with a comprehensive program of on-site in-service tra/iflng 
workshops and individualized assistance in the classrooms, Additional/y , par- 
ticipants engaged/inv^college coursework 'through a .school system sponsored 
program. All training activities were designed to develop teaching skills, 
and an understanding of the foundations of, and development of skills; in the 
use of curricula and material's in bilingual education. These acti vitjies \ere 
coordinated between project* stctff and personnel in thq Office of Bilingual 
Education, school district offices, schools, and colleges attended by the 
trainees.. Paraprofessionals were placed in 24 school? in 14 community school 
districts (C.S.n.) ia Manhattan, the Bronx, and Brooklyn to assist'Tn pro- 
viding instructional services. Through- this coordinated effort, curricula 
and materials were revised and developed, and parents were provided workshops 
and orientation sessions. 

The purposes of this report are the following: ' * 

* 

1) to describe -project cohtext, components,* participants, and , v 
activities; 

2) to describe staff* perception of the project: 

3) to* report student achievement data; ■ 

4) to analyze and interpret project and student achievement data; 

5) to suggest recommendations for possible project improvement. 

tfilihgua'l Pupil Services Ts a nature program with well established objec- 
tives, procedures, and management .Systems. Therefore, little change is evi- 
denced from year to year. Those who read the previous year's report will * 
find strong similarities in th§ sections covering' the project 1 * objectives, 
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organization, sites, target student population, and process of 'project im- 
plementation. Their attention should be principally directed to the sections 
dealin^with the instructional component, summary of staff interviews/ para- 
professionals 1 perception 'of the program, findings, and conclusions and recom 
mendations. These areas include information not covered ih the previous 
evaluation report. 
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I. PROJECT GOALS AND OBJECTIVES ' . 

*\ The ultimate goal of the project is to improve the aca"demic T performance 
and linguistic proficiency of Hispanic LEP students in English. Its instru-* 
mental goal is to develop a comprehensive on-site, in-service training and 
supervision program to be implemented by ^nstructibnal and support services 
personnel trained in the areas of special ization, r^qui red by the target pop- 
ulation. Further, it proposes to develop -curricula and materials for use in » 
the classr.ocm, and involve parents in the educational process of their chil- 

dren. 

j 

Specifically, the project Addressed three instructional and non-instrwc- 
tional „ objectives. These included: 
Instructional Objectives: 

1. In reading in Spanish, participating students will ifchieve a mean 
post-test raw 'score that will surpass their pre-Wst score at .the ■ • 
.05 level, of statistical significance as measured by the Prueba >de 
Lectura-Interamericah Series . 

2. In reading in English, participating students will achieve a jnean 
( ppst-test raw score that will surpass their prg-te^t score at the 

.05 level of statistical significance as measured by the Test of 
Reading-Interamerican Series . 

3. In mathematics, participating students will achieve a mean post- 
test raw'score that will surpass their mean pre-test' score at the* 
.05 level of statistical significance as measured by the appropriate 
level of the Comprehensive Test of Basip Skills (t.T.B.S.) mathe- 
matics computation -subtest. 



Non-Instructional Objectives: . 

y. 

1. Paraprgfessionals will participate in, staff development activities 
in whi*£k they will be supervised and receive training in the teach- 
ing of reading and .mathematics to bil ingual ^students. 
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Bilingual curriculum material s will be developed to meet thfe needs 
of the bilingual students in the project', ^ 

Parents will be apprised of, project activities and .engage in, those 
activities whenever appropriate. ^ v 



f 



II. CHARACTERISTICS OF PROJECT SITES 

Table 1 below lists the districts and schools participating in the B.P.S. 

project, as well as the district enrollments, Hispanic register, ami number 

of Hispanic pupils identified as eligible for bilingual instruction under the 

Consent Decree Program (see Aspira, et. aK , v, Board of Education, et. alQ , 

« 

The table illustrates the distribution of project sites in relation to' the 
number of Hispanic students eligible for services. 

a • 

TABLE 1 . ' 

Participating Community School Districts » 



District 


Di strict- 
Enrollment 

Ci 


Hispanic 

TTnrol-lment- 


- dumber of 
Eligible Pupils. 


'BlP.S. Project 
/School Sites 


3M * 


11,922 


4,425 


* * 

1,458 


P. 145, P.W . • 




12,441 


7,341- 


2,313 


P. 72, P. 112, P. 155 


t 

OM , 


18,931 


13,959 


5,791 • . 


P. 98, P. 28, P. 192 


7B * 


13,904 


8,948 


* 3,279 


P. 65, P. 25 


8B 


20.376 


10,141 


2, -2 18 


P. 60, P. 130, i;s.74 


9B 


27,701 


11,913 11 


4,570 


P. 90, P. 114 


10B 


30, 4"82 


15,556 


4,164 


P. -7 9 


; 12B • 


13,880 


8,693 


2,170 


P.#, P. 211 


13K * 


16,619 


2,781 


967 


P. 133 


■ 14K 


17,580 


11,357 


2,095 * 


P. 120 


--15K 


20,500 


12,013 


2,353 


P.l 


. 17K 


25,158 


2; 83.4 


853 


P. 189 ' • 


23K 


* 11,969 


• 2,036 


845 


P. 155 


32K 


15,479 


10,184 


2,726 


P. 123 



- • • • \ 
The figures above were published by the'Office of Bilingua.1 Education^' New- 
York City Board of Education, October 31, 1981. (M* Manhattan, B* Bronx, 
K* Brooklyn). '* s * 
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Each Qf. these school cornmunities could be characterized aS bilingual and 
bicultural with Hispanics constituting a significant proportion of the popu- 
lation.. For thfe most part,- the participating schools in the B.P.S. project 
refVect !the ethnic composition of tjieir neighborhoods. For example* >in C.S.D. 
#17, whi|ch is a predominantly black school", district, the project's partici> 
,pating school, p.S. 189* has a Hispanic Student enrollment of approximately . 
30 percent one of the highest concentrations of Hispanic students in the 
di strict. Even in heavily Hispanic populated districts, the B.P.S. partici- 
pat1ng> schools were among>those with the highest Hisparfic enrollment in the 
districts. - 

' The evaluator visited seven of the 24 schools involved in'the project. 
The schools visited were in the three boroughs served by the B.P.S., i.e., 
Manhattan, Brooklyn, and the Br*onx. In every instance the schools were lo- 
cated in' area's evincing signs of extensive urban deterioration. The severity 
of this problem ranged from schpols located 1n neighborhoods with pockets of 
prosperity along side deteriorating sections, to schools located in areas of 
almost total* devastation. This contrast is strikingly evident in the neighbor 
hoods of C.S.D,. #3 on the westside of Manhattan and C.S.D. #8 in the South 
'Bronx. 

Title I E.S.E.A. eligibility is determined by* criteria based on economic 
status. and readincj achievement levels. Although the extent and ^nange of 
economic conditions of the participants in the B.P.S. project are not statis- 
tically illustrated here, published figures for 198CT indicate that, of the 24 
schpols in this project, 18 were ranked as being in the lowest quarter of the 
630 elementary and 182 junior high schools ranked according to reading achieve 



v TABLE 2 

Districts, Schools, and Classes Participating 
in Bilingual Pupil Services Project 



District School Grades Number of Students 





145 


3/4, 5/6 * 


35 




163 


2,3,6 


76 


4 


72 


1/2,. .3/4, 4 


54 




112 


1,2 


' 54 




155 


1,2 


40 


6 


28 


1/2, 2, 3/4 


83 




* 98 ' 


1,2,3,6 


- 101 




192 


1,1,4,6 


107 


7 


65 


2,3 


42 




' « 25 


2,3 


37 


V 


* 60 


. 1,2,4,6 


88 




I.S. 74 


5,6 


33 




130 


1,4 


39 


9 


90 


2,3,4 


55 




114 


1,3,3 


78 


10 


79 


3,4,6 


44 


12 . 


• . -77 


1,3 


. 49 




211 


1,2,3 


' 55 


13 


133 


2,3 


52 


14 


120 


2,4/5 


37 


15 


1 


1,2,5 


59 


17. 


189 


1,4 


53 


23 


155 


1,2,3 


76 


32 


123 


4 


19 



Total - 1,366 

* > 



* Slash (/) indicates bridge classes. 



III. PROGRAM ORGANIZATION AND PERSONNEL 

THE OFFICE OF BILINGUAL EDUCATION (O.B.E.) 

The Sffice of Bilingual Education's a. central adminstrative unit within 
the New York City Public Schools. The Office consists of six centers which 
provide numerous support service activities in the area of bilingual education. 
The^ organization of O.B.E. is illustrated in Figure 1. 

r .As a:, : staff development and instructional services project, B.P.S. is part 
of the Center for Staff Development and Instructional Support Services. 'This 
center^?, major focus wj^hiji O.B.E. is to provide training to individuals in- 
volved in the teaching of limited English spewing children in the city school 
system. Five distinct projects were included within this Center in 1081-82. 

Each of these projects had a particular programmatic purpose as well as ,a 

• — %J 

role within the Center's overall staff training activities, and O.B.E. goals. 
It is interesting to note that the director of the Center for Staff Development 
once served as director of the B-sP.'S. project and the assistant director was 
once a field instructional specialist. Of interest also is the fact that ' 
three pt)}er 9 projects in the Center were designed using the B.P.S model. It 
appears that the B.P.S. project was an early advocate of providing in-service 
training to bilingual educators while they provide direct services to students. 
As part of the Center the director of the B.P.S. project reports to the director 
of the Center for Staff Development. The organization of the B.P.S. project 
is illustrated in Figure 2. 
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FIGURE 1 

Organizational Chart: Office ot Bilingual Education 
1981-82 
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FIGURE 2 

Organization of the Bilingual Pupil Services Project 
Under the Office of Bilingual Education v « 
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STAFF ENGS 

The following were the full-time staff "positions in the B.P.S. project 
and th$' responsibil i ties of each: 

The director was responsible for the overall administration, coordination, 
\and supervision of the project and each of its components. 4 " She functioned as 
program liaison with state and city of ficial-s -and project evaluators in the 
administration Qf the project. The director has been in the positioif for 
three years and has been with the project for over ten years. The director* 
is bil'ingual, holds B.A. and M.S. degrees and is certified as an administrator 
and_gupervisor. She has thirteen years of combined teaching and supervision 
experience. * 

The. assistant director aided the director in the coordination of pupil 
services, in-service training, and parent community activities with ^partici- 
pating C.S.D.'s and colleges. The assistant actedas liaison between the 
project and school principals, and also assisted in the orientation and super- 
vision of the four 1 field instructional specialists (F.I.S.),. The asj&istanf 
director assumed his position in February, 1981. Before then, he was<a F.I.S. 
The assistant is bilingual, holders. A. and M.S. degrees, and a certificate as 
ran administrator and supervisor, and has seven years of teaching experience. 

A 

» The project had four F.I.S. 1 s. 'In general their responsibilities fell 

k * * % 

f under the categories of training* supervision, and administration. 

: Specifically^the F.I.S. 's under the supervision of the director and the 

; assistant director, provided a variety of in-service training activities for 

paraprofessional s in the content areas of mathematics, reading, E.S.L., and 

materials development. In addition, duties included: meeting periodically 
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with the assistant director to discuss course outl ines, curricula, lesson 
plans, time- lines, and related nfatters; meeting with other F.I.S.'s regularly; 
insuring the proper packaging, delivering, and di stributing -of instructional 
material^; insuring strict adherence to attendance rules; collecting and check-: 
ing attendance, roll books, and reporting items of importance to the central 

* r 

office staff (such as paraprofessionals' response to in-service program con- 
tent); and acting as the project representative in contact with district school 
staff. • 

All the F/I.S.'s are bilingual, have a minimum of a:Master' s Degree, and 
teaching experience ranging from five to nine years. Three F. I . S. were 'experi- 
enced in their jobs as field specialists, having been on the job from. two to 
three j^ars. The fourth started to work in September of 1981 • 

The project staff also included an accountant, secretary, payroll *secre-- 
tary, receptionist, and typist, who were respectively respon§ible~Yor financial 
secretarial, and clerical ^matters, undfc*^the supervision of the tii rector ^and 
assistant director. & 

The project's school site staff included 57 paraprofessionals at the, con- 
clusion of the 1981-82 school year. The project began the year with 60 para- 
professional s but .encumbered three vacancies when two paraprofessionals we;e 
appointed to positions as bilingual teachers and one took maternity leave. 
The primary responsibility of participating. paraprofessional s was to provide 
bilingual instruction in reading and mathematics to assigned pupils of jl imi ted 
English proficiency. Secondary .was the paraprofessional 's required partlcipa- 

4 

tion in the in-service training programs (monthly workshops/in-service) con- 
ducted by the F.I.S.'s. They also had to attend college to complete baccalaure 
• ate degree'and required education-credit requi rements needed for state certi- 



fixation/city licensing as Bilingual teachers. Project 'records indicate that 

<X-> 

allp^raprofessionals were Spanish-speaking and from similar cultural back- 

groundsXas the children. They were selected on the basis of interviews, oral 

and writt^Q^exami nations of Spanish and English language proficiency, and con- 

sideration of|^be candidate's academic record. Individuals selected were those 

* 

who: a) had consisted a minimum of 60 college credits; b) demonstrated commit 

ment to the field b£ education; c) could effectively implement project objec- 

: % 

tives by "providing instruction to the participating students as well as 

V 

enhancing their own skills and knowledge of bilingual methodology; and d) were 

» >? - 

fluent in English and Spanish. 
* 

%^ 

SUPERVISION * Y\ 



€ The^B.P.S. project kept extensive records on the development of each para- 
professional. These include on-g&ing informal assessments of the performance 
of the paraprofessional s, as well ^|||ormal lesson and general performance , 
evaluations conducted by the F.I.S.Wee Appendix A for sample of evaluation 
instruments.) < <v f%t 

1 Field instructional specialists were Required to make .daily entries into 
the log books, which yere checked weekly by%the director and her assistant. * 
The logs provide "documentation of ,all projectt:activi ties engaged in by the 
F.I.S. at their assigned project sites and at headquarters. For example, 
these- logs provided descriptions of the training ^dividual paraprofessional s 
received at their schools. The logs contained information on the school and 
the B.P.S. paraprofessional s, as well as other data relevant to the implementa- 

tion of the project. Also included were observations'* on the school situation 

\ * 

which had implications for the^ functioning of the parapr&£essionaJs, including 
school support for hilingual education. \ 
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The logs also contained records of all contacts between the F.I.S.'s and 

the site personnel, including interviews, observations, entries describing 

*i . * 

the classrooms, and every visit made. Records were kept of lessons given, 
resources distributed, and materials developed. In sum, the logs give a de- 
railed description of the activities of the F.I.S.'s in the schools and at 
the central offi-ce. . 

I NTE R OR 6AN I Z AT I ON AL ARTICULATION ~ 

In maintaining and reinforcing linkages with personnel at the project sites 
and also with other units within the Office of Bilingual £ducation, the B.P.S. 
project staff had clearly articulated activities. The activities served to 
enable, to the extent possible, closer control over project activities despite 
the wide dispersion of paraprofessionals throughout a* large number of school 
districts and schools. This effort seemed to require much energy and consis— 
tency,'but the impression is one of success. 

Specifically, the B.P.S. staff maintained close and on-going communications 
with each school administration involved, and to a lesser extent with the ad- 
ministration of district bilingual programs. These contacts included both 
written and telephone communications, and meetings with school principals 
and teachers. The project director and the assistant had both visited and 
were familiar with all the project sites. The F.I.S.'s however, were the pri- 
mary link between the central office and the paraprofessionals. Approximately 
50 percent of the F.I.S.'s time was spent at the project sites providing super- 
vision and maintaining channels of communication with local schools and, school * 
district personnel. The percentage of time spent by the F.I.S. at the proj- 
ect sites decreased by JO percent" from the previous school year. This decrease 




r 



occurred as a result of new Office of Bilingual Education regulations requiring 

the F.I.S.'s to report back to the central office after site visits everyday no 

later than 2:00 p.m. Nevertheless, since training took place orf a weekly basis 

• / 

each F.I.S. came in contact with assigned paraprofessionals every week. 

Project staff also collaborated with other resource and training units % * 
within the community school districts, the Center for Staff Development, and 
wlttr other agencies involved in providing training workshops aind conferences 
for the bilingusft educator. This cooperation took the form of presenting at 
or participating in scheduled workshops and conferences. For instance, the 
B.P.S. staff presented at the Center for Staff Developments prientatioa work- 
shops, Project Parent Awareness, the Center for Evaluation, the Office' of 
Educational Opportunity hud to a group of administrators, teachers, and para- 
professibnals from the Division of Special Education. In addition as- part of 
the project's monthly workshops different guest speakers were used. This in- 
cluded four publishing companies that gave workshops on new E.S.L. readers 
and mathematics materials. * 
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IV. PROGRAM ACTIVITIES 

RECfruiJMENT, SCREENING, AND ORIENTATION OF PARAPROFESSIONALS . 

All applicants for the positions of paraprofessional s were evaluated by 
the project staff. The educational characteristics .of the applicants were 
carefully considered in an effort to identify each applicant's strenqths 
and" areas of n$£d, and also to ascertain the potential for success in teach- 
inq. A total of 55 persons were screened during the 1981-82 academic y-ear. 
The screeninq process was carried out in a well orqanized manner and included 
the following steps {see Appendix B for samples of screeninq ^instruments) : 

- The Applicants wjere notified by mail to appsaf at project 
headquarter^. • " 

- Each applicant was administered a written short answer test in, 
Enqlish ( 'Michigan Test of English Proficiency ). They were also 
requested to write a 200 word composition in English and one in 
Spanish. They were allowed to select from eiqht atopic questions, 
fqur each- in Enqlish and Spanish. A typical question was 'What 
Wthe importance of incorporating a pupil's interest in an in- 
structional proqram and how can this be accomplished?" 

- The applicants were interviewed in both Enqlish and Spanish. 



- Finally, they were required to have a minimum of 60 collGqe 
credits. 

- The test, compositions, and internets were scored. 

• - A final determination was made as to which applicants' would 
be selected. This determination was made with the participation 
of the whple B.P.S. .pedagoqical staff. Candidates were selected 
based" on jtheir scores on the various instruments, on the applicants 1 

» grades on colleqe trariscripts, and the degree to which the > 
applicants provided evidence of a desire to undertake and ^ 
perform^hk role of B.P.S. paraprofessional, including a 
commitment t(\ take part tn all scheduled traininq activitiesr^ 
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Orientation was provided to new and .continuing paraprofessional s in 
September, or at the time the rrew employee entered the project. The 
orientation sessions covered a variety of topics. Included among these were: 

- Orientation to the Bilingual Pupil Services project 

- Duties and responsibil i ties'of paraprofessionals * 

- Personnel procedures i 

- Title I guidelines and priorities 

- Roles of the F.I.S. and other-central office staff 

' - Relationship of the B.P.S. project to local district x 
schools and other outside agencies, such as the parent 
advi sory groups 

- Project evaluation procedures 

- Individual professional deved opmept * 

- Schedules of project report § and activities 
Statistical surveys of pupils find pupil needs 

- In-service education program 

- Basic classroom operations lesson plan preparation, 
resources information, pattern drills, use of visual aids, 
control of classroom groups, pupil profiles 

- Bibliography and glossary - 

- Pre and post testing procedures and schedules 

- Bilingual Paraprofessional Advisory Committee 

- Personal conduct ' 

In September the school principals and directors of local bilingual programs 
were informed of which paraprofessionals would be assigned to their schools. 
New paraprofessionals were personally introduced by the F.I.S. 's to ,the directors 
and prinripals. During this time the principals were oriented concerning the 
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responsibly ties of the paraprofessionals and reminded of the school admini- 
stration's responsibility i.n adhering to regulations governing the assignment 

of the B.P*S, paraprofessionals. Among these regulations were included the 

. s 

following: • 7 

S 

- Under.no circumstances may a paraprofessional be" left alpne with 
children in a classroom. A teacher must supervi se. the parapro- 
fessional in the classroom at all times. 

- The paraprofessional must not be given. duties which do not 
appear in his/her job description unless the project is con- 
sulted of these first; for example, no lunch duty. 

* • - The paraprofessional 's time card and time sheet must be 

signed by the principal of the school apd brought to the 
central office. It at anytime this duty, is delegated to 
another individual, the central office staff must be official ly 
informed. ^ * * / 

- The paraprofessional must report promptly and record time 
accurately upon arrival .and departure. 

-All paraprofessionals must follow appropriate procedures in 
reporting absences and lateness. The school and the office 
must/be notified on the day of .the absence or lateness. 

- The paraprofessionals should avoid, outside commitments that 
would make it necessary to request, a modification of His/her 

4 assignment of days and hours. 

^ . - The paraprofessional must provide the school with schedules 
Showing assignment of days and hours. 

- Paraprofessionals must take their prep.-periods at the same 
time their cooperating teachers take them. At least one of' 
these prep-periods per week must be a supervisory conference 
between paraprofessional and teacher. The topics discussed at 
the conference will be logged. by the paraprofessional and kept 
in a section of his/her lesson plan notebook entitled "Super- 

N vi sory Conference with Coop^rating Teacher." > 

- The participating teacher and, or supervisor with the approval 
of the principal, must evaluate'each paraprofessional 1 s work 

,at least twice a year. The B.P.S* project will provide the " 
official evaluation forms to be used. This appraisal should 

'be subject to review and annotation by the principal before*, 
it is forwarded to the project. * "c 
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- All paraprofesslonals will'be observed formally twice a year 
and informally several times #during the year* The first 
fomjal observation will take place from mid-November to, mid- 
December, and the second observation will be from mid-April 
to mid-May. 

- Use of release time (for school related matters only) must 
be approved by the director. Paraprofesslonals are entitled 
to only 2 1/2 hours of release time a week. No release time 
in excess of two and one half hours will be approved. 

, * * 

INSTRUCTIONAL COMPONENT 

The evaluator visited seven (of 24) project schools and observed a total 
of fifteen paraprofesslonals engaged in instructional activities. In every 
instance paraprofesslonals were assigned ^fe^ork with a bilingual teacher. 
Paraprofesslonals taught within the classroom, usually in a designated area 
of the room where small groups of children would gather to work with the 
paraprofessional . Where the paraprofesslonals gathered.wi %h their pupils 
seemed to depend on the size of their assigned student group. All Qf the 
paraprofesslonals observed had adequate instructional space in relation to 
the available classroom facilities. 

Each paraprofesaional was required to provide instruction in reading and 
mathematics* to at least 22 pupils. An intent of the instructional program 

was to allow for as much individualization as possible. To that end, the size 

i 

of student groups ranged frjxn four to eight students. Although the daily in- 
structional' routines of the paraprofesslonals were occasionally altered to 
accommodate particular student needs or because of an activity in which the 
whole cl.ass engaged, the typical paraprofessional teaching alignment closely 
resembled the schedule below: 
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8:40 - 9*00 Morning activities: attendance, collection, calendar, . 

weather . ' f 

9:00 - -9:45 Reading * 

10:00 - 10:30 Language arts - writing skills 

10:30 - 11:15 Mathematics 

11:15 - 12:00 English as a second language (as part of the pre- 
reading phase) 

' 12:00 - 12:30 Lunch 

12:50 - 1:30 Mathematics activities ' • 

1:30 - 2:00 Reading through content area (i T e., social studies) > 

2:00 - 2:45 English as a second language (as part of the pre- 
reading phase) 

2:45 - 3:00 Independent reading activities 

The evaluator observed the teaching of lessons which ranged from 30 to 40 
minutes, and Included the observation of paraprofessional s teaching reading,., 
English as a second language, and mathematics. A total of ^fifteen parapro-^ 
fessionals were observed engaged in instruction. The classroom observation 
visits were not announced since their intent was. not to render judgements on 
the quality of instruction, but rather to observe, first hajid, how project 
instructional activities were being carried out. 

All of the paraprofessional s observed demonstrated knowledge of the goals 
and objectives of the instructional program. Observation of their teaching 
performance indicated that they are able to prepare and present lessons based 
on the- pedagogical principles in which they were trained. , For example, in 
the lessons observed, most paraprofessional^ had specific objectives, used 
various motivational techniques, followed an instructional sequence in which 



concepts were presented in progressively more complex form, and applied a 

variety of learning principles including associative strategies, positive 

reinforcement, and behavioral consistency. 

Among the paraprofessionals observed, there was a rioticeable difference in 

* * 

i 

teaching performance between those who had participated in the B.P.S. program, 
for less than one year and those who had participated for at least ope and 
one-h^lf years. The more experienced paraprofessional s maintained students 1 
attention by using varied techniques and materials, responded more readily .to 
students 1 cues for clarification, and appeared more relaxed and self-confident, 
while teaching.. To a great extent, this variation in teaching performance % ' 
seemed to be a function of the length of time in the B.P.S. program.. The more 
experienced paraprofessional s had received more training and feedback on their 
teaching performance from the F.I^J.'s and the classroom teachers.^ <> 

In the Spanish reading classes observed, the paraprofessionals used a 
"variety of approaches, methods, and materials. For beginning readers the 
phonetic approach' was predominantly used. This approach to teaching reading ' 
in Spanish has been generally favored over others due to the linguistic fit 

of the language, i.e., the -consistency of sound-symbol "correspondence. The 

» 

parapntyfessiorials observed Were able to apply this approach very well. For 
Htfvanced students, the paraprofessionals applied the Spanish reading approach 
us&ctvSi the reading series that had been adopted by the school /bil ingual program 
to which they were assigned. These included the phonetic, linguistic, visual, 
■ and experiential approaches. While one particular apprq|ch usually predominated 
within a Wesson, all the paraprofessionals observed used mpre than one approach 
in teaching Spanish reading. A widely observed combination was that of the 
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phonetic and experiential approaches. In using the latter*approach, the para- 
professionals elicited and emphasized vocabulary related to students 1 activities 
in school, at home, and in the neighborhood. The most frequently observed 
method of teaching Spanish reading was the guided reading method which included 
the following^ steps: the teacher (1) introduces topic, (2) asks motivational/ 
guidi'ng questions, (3) 'engages students in a reading selection-, (4) asks com- 
prehension questions, (5) engages students in reinforcement activity, (6) 
offers students feedback on their performance, and (7), assigns related home- 
work. Materials utilized by the paraprofessionals in Spanish reading inclbded 
both self-devil oped and commercial ly' prepared materials. .Some\of these materi- 
als included £ames, pictures, flash cards, stories, and poems. 
t 

All paraprofessionals who were observed teaching Spanish reading used Spanish 

consistently throughout the lessons. They, also .used methods of inquiry which 

( 

were clearly aimed at developing students 1 reading comprehension. However, 

/ . . 

the paraprofessionals observed tapped primarily lower level thinking skills 
through their questioning. For example, most comprehension questions required 
identification or recall while very few required analysis, inferences, syn- 
thesis, or general izat ions. \ 

The^E.S.L. classes observed ranged from beginning levels involving oral 
language development to advanced levels which included reading and writing 
in English. Paraprofessionals working with beginning E.S.L. students us'ed 
a variety of activities such as games, role playing, and dialogues to teach 
sentence patterns and reinforce vocabulary. These paraprofessionals also used 
varied, colorful materials which maintained student interest. In most of the 
English reading classes observed, paraprofessionals followed a similar in- 
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structional sequence in -the process of developing reading comprehension and 
reinforcing acquired vocabulary* First, students took turns reading aloud, 
followed by a linguistically controlled activity which usually included visual 
aides^to promote understanding. Paraprofessional s then usually checked each 
student's work individually. 

In all E.S.L. classes observed, the paraprofessional s modeled the correct 
pronunciation of target vocabulary in complete sentences in order to assist 
students. There was also consistent use of positive reinforcement following 
appropriate student responses. In addition, with one exception, paraprofes- 
sional s used English consistently throughout their E.S.-t. classes. It should 
also be noted that some of the paraprofessional s observed teaching E.S.L. 
had more than eight students in their group which in all instances limited / 
the paraprofessional 's function of providing individual attention. Also, 
as with Spanish reading, the paraprofessional s observed teaching reading to 
advanced E.S.L. students tapped primarily the more elementary thirfking skills 
through their questioning. 

Only one mathematics class was observed. Therefore, it is impossible to 
generalize and make subsequent recommendations as to math instruction in the 
B.P.S. program based on such a limited sample. It is important to note, how- 
ever, that the paraprofessional observed presented a well -structured math 
lesson aimed at conceptual development rather than rote learning. She used 
a variety of teaching techniques* and motivating, self-developed materials to 
which students responded enthusiastically. ^ % 
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STAFF, DEVELOPMENT V 

The project 1 s u Vn-service training activities were intended to develop those £ 

teaching skills which are essential in instructing the bilingual pupil, and for 

familiarizing the paraprofessional with cur riculxim. and materials. Specifically, 

these activities fel 1 into four training areas: 

S. the methods and techniques used in teaching reading and 
mathematics in the native and second languages; 

* b. the selection -and evaluation of reading and mathematics 
materials for use in the bilingual classroom; 

* c. the development of bilingual materials for the reading 
and mathematics programs; 

d. the method? and. techniques used ih teaching English as 

a second language, before the introduction of reading. * * 

The in-service training plan in 1981-82 required that all new paraprofes- 
sionals (and some in their second year who needed additional training) attended 
a weekly all -day training workshop. These workshops were conducted on Mondays. 
During the fall and spring a total of 23 all -day sessions were provided. The 
fall program began in October and ended in December. The spring sessions began 
in January and ended in May. All of the workshops were held at the project 1 s * " 
headquarters. x 

TheCMonday workshops were conducted by the F.I.S.'s who assessed on a con- 
tinuing basis curriculum areas which needed particular emphasis. In general, 
however, they attempted to structure Monday workshops in such a way as to 
cover all of the subjects the paraprof essional s were responsible for teaching. 
A typical Monday workshop lasted six hours and was scheduled to cover th^ 
areas listed below: 
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9:00 



9:15 Lab'session (distribution of materials and memos) 



9:15 



10:15 Teaching mathematics 



10:15 



11:10 Teaching reading 



11:10 



12:00 Reaching -E.S.L. 



12:00 - 1:00 . Lunch t. 
1:10 - 3:00 Bilingual materials development 
Irr addition to providing the ski-lls and knowledge which enabled the new 
paraprofessionals to structure their lessons, the weekly workshops also afforded 
the F.I.S.'s the opportunity to establish'a rapport with the paraprofessionals, 
-It was evident ^to the^evaluator that the paraprofessionals knew much about 
their assigned F.I.S.'s and viewed them as mentors. In general, they were 
appreciative of the direction and assistance proyided by the F.I.S.'s and 
'welcomed their presence in the clas.srocms and schools. 

It is estimated that the F.I.S.'s spent appho^ma te ^ y 50 percent of their 
work time on the supervision of their assigned paraprofessionals. .This level 
of involvement, coupled with the various workshop sessions they provided, 
meant that each para'professional spent a substantial number of contact hours 
with their F.I.S.'s (approximately 150 hours for new paraprofessionals and 80 
hours for others). However, much care was taken to insure that classroom 
instruction time was not interrupted. When the F.I.S.'s made site visits, 
they arranged to meet with the paraprofessionals either: 1) during a prepara- 
tion period; 2) during lunch; and/or 3) after school hours. 

After their first semester in the project paraprofessionals are required to 



attend only one monthly al It-day workshop. New paraprofessionals are also re- 
quired to attend these monthly workshops. In 1981-82 these workshops were 
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held at one of the participating school ^districts or at the B.P.S. project 
headquarters and were usually conducted, by the F.l.S. assigned to that group , 
of paraprofessional s (there were four groups). The subjects covered at these 
sessions were those that had. been determined by the F.I.S.'s to warrant par- 
ticular attention. During the yearthe F.I.S.'s conducted nine monthly ses- 
sions; These included: * 

a. demonstration lessons by paraprofessional s and field instructional 
specialists in Spanish reading, E.S.L., and mathematics; 

,b. presentations on how to integrate culture into the curriculum; . 

c. presentations by various publishers on, bilingual classroom 
materials, e.g., Open CourfPublishing Company, Scotts Foreman 
Publishing Company; 

\ 

d. use of media in the classroom, e,g., photography, slides,, film- 
strips, and tape recorders; < 

e. maintaining pupil records; 

i 

f. testing and evaluation; 

g. materials development. 

■ Another aspect of the staffs development plan involved courses taken by 
paraprofessional s toward thexompl $tion of the B.S. or R.A. degrees. Under 



the Career Training Program/ the Board of 'Education paid for up to six credits 

f m 
per semester for each paraprofessional. The paraprofessional s were free to 

attend any college they desired; however, the Board of Education paid tfnly 

. ft 

for course work at any of the city college**- The majority of the^ participants 
attended the City College of New York. «' 

This year, during the spring semester; in in-service course on meeting the 
special needs of limited English proficienpy students was provided. The course 
sessions were conducted by guest speakers and 'B.P.S. project staff. A total 
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of ten sessions were held a£ B.P.S. project headquarters, lasting from 9:00 
a.m. to 3:00 p.m. • " 

The director, assistant director, and the F.I.S.'s were-also involved in 
receiving training. They attended workshops given by O.B;E. 1 s- Center for 
Staff Development which addressed such topics as E.S.L. and language learning 
through the arts, evaluation and testing, managerial training, educational law, 
and racial and sex stereotyping in textbooks. (For sample schedules of all 
staff development activities see Appendix C.) , 

Paraprofessionals usyally remain with the project from two to three years. 
In 1981-82, the B.P.S. project trained a total of 57 paraprofessionals. Of 
these, a total of sixteen (or 28 percent) received their baccalaureate degree 
at an approved college and completed their training in the B.P.S. project. 
Based on the project's previous placement record, the B.P.S. project director 
anticipates that at least fifteen graduates will be appointed as teachers. 
Since 1972, 782 B.P.S. paraprofessionals have earned their baccalaureate degrees 
and the majority have- joined the teaching ranks., 

CURRICULUM AND MATERIALS DEVELOPMENT * 

Curriculum and material s development was the subject of several in-service 




veloped during the cou(£s<e of the academic year and the Teachers Guide for the 
Teaching of Reading in Spanish and Engjish as well as the Survival Kit 

were- updated. 



B.P.S. project staff also revised the manuals that had been developed in 
previous years for paraprofessionals, field instructional specialists, and 
clerical staff. In addition, reference materials* were added to the mini- 



resource library including teaching references, various commercial reading 
series, and instructional guides and aides. 

PARENTA L INVOLVEMENT 

- — — — ■» 

The project director conducted five meetings for the parents of the pupils 
receiving instruction, and for parents who. were members of the Parent Advisory 
Committee* Through these meetings, parents were informed about Title I guide- 
lines, B.P.S. program objectives, and roles and responsibilities of program 
participants. Parents* were also kept abreast of developments that affected the 
education of their^chil dren. 
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V. SUMMARY OF STAFF INTERVIEWS ■ 



t\s part of the evaluation procedures, the evaluator interviewed the B.P.S. 

pedagogical staff including the project director, the assistant director, and 

the four field instructional specialists. The purpose of the interviews was 

■ 

twofold: v 

(1) to vertfy staff roles and .responsibil ities within ihe program; 

(2) to obtain their assessment of the B.P.S. project in teems of 
strengths and weaknesses*, ^ 

Four of the six staff members interviewed (or 67 percent) believe that 
the program's major strengths lie in the commitment, sensitivity, and ere- 
ativ.ity of the paraprofessionals and in the experience and specialized compe- 
tence of the F.I.S.'s Moreover, three staff members ,(or 50 percent) agreed' 
that the B.P.S. program ! s contribution' to L.E.P. students 1 progress in reading 
and math as well as the supportiveness and cohesiveness of the project staff 
also represent major strengths. Two staff members (or 33 percent) identified 
program management as a major strength. 

There was less consensus regarding program weaknesses. Three individuals 
felt that a decrease in time spent by F.I.S.'s'in program schools due to a 
new Board of Education policy resulted in a weakening of services. However, 
this is beyond the program's control. Another major weakness was £ lack of 
coordination between the project and the colleges attandedby the^parapro- 
fessionals. Three staff members felt that the "program Should assist colleges 
in identifying and meeting paraprofessionals 1 needs, such as courses to re- 
mediate deficient Spanish/English writing skills, and courses dealing with 
the teaching of culturally diverse students* Although there was little con- 

r 

H 



sensus in other problem areas, one individual each mentioned the followinq 
problems: some paraprofessionals remain in the program for more than three 
years; it is difficult to expel 1 incompetent paraprofessionals; recruitment J 
and screening procedures need improvement; more' coordination is needed in 
scheduling visitors and evaluators which result in disruption of school 
activities. 

In general there was more .consensus in identifying proqram strengths than 
weaknesses. 
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VI. PARAPROFESSIONALS' PERCEPTION OR THE B.P.S. PROJECT 

A questionnaire developed by the Office of Ideational Evaluation (see 
Appendix D) was completed by the 57 paraprof essi onYl s. The ^questionnaire is 
composed of four types of questions; 1) paraprofessionals' demographic charac- 
teristics and educational background; 2) rating, of 12 programmatic and admini- 
strative aspects of the program on a scale from cine (inadequefES^Co^ive * 
(excel lent) ;» 3) rating of the adequacy of thirteen of the program's training 
activities; and 4) general comments N and suggestions for improvement of the 
program.. 

DEMOGRAPHIC AND EDUCATIONAL CHARAC TERIST ICS 

: > 

_ As indicated in Table 3, a majority of program paraprofessionals were born 

in Puerto Rico with the next largest group having been born on the United States 

mainland. The Puerto Rican dominance of this group is further enhanced by the 

fact that of the 16 mainland born paraprofessionals, 15 were the children of 

Puerto Rican-born farents. Thrus 83 percent' of the group were of Puerto Rican 

background* Six were from the Dominican Republic. The vaSt majority (83 'per- 

cent) were female, with on>y ten males in the group. , 

A breakdown by age group is presented in Table 4. The largest group (42 

percent) were in the age range of 31 to 40 years of age with more than one- 

f Start h between 30 and 36. One-third of the paraprofessionals were 30 or 

younger. In general, then, this was not a group'of young people, but rather, 

people with a good deal of life experience in addition to solid educational 

backgrounds. * 
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TABLE 3 

Location of Birth of Program Paraprofessional s 



Location 



Number 



Percent 



Cumulative Percen 



Puerto Rico 

United States Mainland 

Dominican Republic 

Colui&ia 
Cuba ^ 
Ecuador 



32 
16 
6 

1 
1 
1 



56 
28 
11 - 

2 

2 

2 



56 
"84 

' 95 
97 
98 

100 



TABLE 4 . 
Program Paraprofessional s by Age Group 



Age Range 


Number 


Percent 


Cumulative Percent ^ 


20 to 25 


10 


18 


18 . 


26 to 30 


. 9 


16 ' 


33 


31 to 35 


15 


\ 26 


60 


36 to 40 


9 


16 


75 


41 to 50 


12 


21 


97 


Over 50 


e 

2 


1 4 


100 



Teachinq experience in the qroup ranqed from two months to six years, with 
an average of 2.4B years and standard deviation of*1.58 years. Experience was 
well distributed over the elementary school years with at least 10 parapro- 
fessionals havinq taught at every level from first to sixth. The larqest 
number (21) had taught second qrade. 

As two years o^ college credit were a requirement for participation in the 
^ prpqram, all paraprofessional^ had.hadNa good deal of college experience. In 
fact, they reported an average .of 109.3 college credits (standard deviation = 
27.6) either in proqVess or already completed. One in four paraprofessionals 
indicated that they expected to graduate from colteqe by June, 1982. One 
paraproffessional indicated that he already had a tleachinq license and seven 
others expected to receive theirs by September! 1982. 

PROGRAM COMPONENT RATINGS _ * 

Each respondent was asked to rate twelve proqrammatic or administrative 
areas of the proqram using the followinq ratinqs: 

• ' ••/. , 

- — * 1 = Inadequate 

* 2 = Below Average ^ . "* 

3 = Average 

4 = Good . 

5 = Excellent 0 



TABLE 5 

Means and Standard Deviations of Paraprofessional Ratings of 
Programmatic and Administrative Components of the Program and 
Percent Rat.ing the Component as "Excellent" 



Program^ Characteristics 


Mejan 


oL cmud ru 

Deviation 


Percent 

"F vrol 1 ont " 

lxlc i i ent 
Ratin,g 


Accessibility to Field Instructional Specialists** 


4.54 


.0.60 


60 

& 


Adequacy of communication between program staff 
and paraprofessional s** 


4.49 


0.63 


56 


Quality of on-site training of program participants 4.55 


0.57 


59 


Usefulness and' relevance of the monthly workshops 


4.65 


0.52' 


67 


Usefulness and relevance of weekly in-service 
training ^essions* 


4.75 


0.47 


77 


Usefulness and relevance of materials in the 
mini resource center 


4.56 


0.54 


58 


Accessibility to mini resource center materials** 


4.52 


0.57 


54 


Advisement of paraprofessional s on professional 
and academic matters 

r 


4.65' * 


0.58 ■ 


70 


Follow-up by F.I.S.'s on paraprofessional needs**^ 


4.60 


0.50 


60 


Feedback by F.I.S.'s on paraprofessional progress* 


4.61 


0.4? 


61 


Scheduling of program activities*" 


4.42 


0.57 


46 


Overall quality of Bilingual Pupil 
Services Program 


4.88 


0.33 


■ 88 



Scale: .1 = inadequate; 2 = below average; 3 = average; 4 = good; 5 = excellent. 



* Significance of correlation with expectation of graduating less than .10 
** Significance of correlation with expectation of graduating less than .05 
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As indicated in Table 5, all ratinqs were extremely favorable, with averaqe 
ratings ranginq from 4.42 for "scheduling of proqram activities"- to ,4.88 for the 
"overall quality" of the proqram. The "schedulinq of proqram activities" was 
the only area on which a majority of tt?e pa raprofessionals did not qive the 
proqram an excellent ratinq. On the other hand, 88 percent of the parapro- 
fessionals rated the B/P^S. project as "excellent." Other areas in which re-' 
sponses indicate that small improvements miqht be made include communication 
between staff and the paraprofessionals and in the accessibility of materials 
in the mini resource center. 

In addition to the ratings of the general program characteristics, the 
paraprofessionals were also asked to "rate the adequacy with which the areas 
listed below have been addressed by the various training activities" of the 

w V 

program. The same 5-level scale was used in making these ratings. Table 6 
presents the results. 

The program's training activities were qiven ratings almost equally posi- 

c 

tive to thosegiven the general proqram characteristics. Areas rated most 
highly include the development of personal qualities useful in the classroom, 
instruction on the keeping of student records, and the development and use of 
instructional aides. Areas where relatively lower ratings indicate that the 
program miqht focus future effort include instruction on the use of content- 
area material to teach lanquage, the development and use of curriculum, assess- 
ing student lahguaqe and academic proqress, methods of teachinq bilinqual 
mathematics, and incorporating the 'Student 1 s culture in the instructional pro- 
cess. As in the ratinqs of overall characteristics, the small standard l^via- , 
^TTons and very high ratinqs indicate that virtually all respondents gave the' 
program a "good" or "excellent" ratinq in almost -all areas. 



Me 



TABLE 6 



leans 'and Standard Deviations .of Paraprofessional s ' Ratings 
of the Adequacy of Program Training Activities in the 
Following Areas, and the Percent of Paraprofessionals 
Giving an "Excellent" Rating.* 





> 

. — Trsi ninn Arpa 

— 1 1 a 1 11 i iiy mi ca 


Ma a n 

• ICO II 


Standard 

UCV 1 u UUII 


Percent 
'Excellent' 

r\d u i iiy 


« 

Lesson nlannina 

\» tj «J V/ 1 1 Ul U 1111 1 1 IM 


4 58 


0 63 

U« J*T 


53 


Methods of teaching reading in the bilingual^ 

V* IQ JJl Will } 


4 53 


/ H4 


Methods of teaching mathematics in the bilingual 
c lassr oan* 


4,49 


0.57 * 


53 


I 

Methods of teaching E.S.L. in &he bilingual 

r 1 a c c p nnm * 

\* i u j Jl Will 


4 51 


o 63 


DO 


Methods of teaching language through the 
content areas 


4.42 


0.65 


51 


Incorporation of the students 1 culture.(s) 
within the instructional process** 


4.49 


0.57 


'53 


Curriculum development, adaptation, and 
utilization** 


4.42 


0.65 


51 


Development, adaptation, and utilization 
of instructional aides 


4.61 


0.53 


63 


Lanauaae and academic assessment of bilinaual 
students 


4.47 


D.68 

• 


58 


Approaches fiSifr motivating student^ in the 
teaching/learning process 


4.60 


0.53 


61 • 


Keeping records of students' progress 


4.63 


0.52' .. 


65 ' 


Grouping/individualized instruction in the 
bilingual classroom 


4.60 


0.53 


"61 


Development of personal qualities leading t& 
effective teaching in the bilingual classroom* 


4.66 


0.48 


66 



Scale: 1 = inadequate; 2 = below average; 3 = average/, 4 = good; 5 = excellent. 

i ! 

* Significance of correlation with expectatiort of graduating less than .10 

** Significance of correlation with expectation of graduating less than .05 
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RELATIONSHIPS BETWEEN DEMOGRAPHIC/EDUCATIONAL CHARACTERISTICS AND RATINGS 

To determine whether paraprofessional s 1 characteristics wgre related to. 
the component and training ratings, PeafSon product-ftoment correlations were * 
computed between characteristics having a continuous distribution and all 
25 ratings. The continuous variables include the following: number of years 
that^JTe par'aprofessional had participated in the program, number of college 
credits expected to have been completed by June 1982, whether or Dot they 
expected to graduate from college by June 1982, sex, and age group. In addi- 
tion to these correlations, two noncontiguous variables '(whether the parapro- 
fessional had a teaching license, expected to get it soon, or did not expect 
to get it, and the location of the paraprofessional's birthplace) were cross- 
tabulated with the four ratings which had the greatest variability and with 
the rating of overall program quality. 

An examination of • the results of theser analyses indicates there is 
little relationship between four of the individual characteristics (years in 
the program, college credits, sex, and age) and any of the ratings, while 
there are strong relationships with the remaining three characteristics. 
Correlations with the paraprofessional's expectation of graduating from college 
were statistically significant (r=.221 or larger) for seven of the 25 ratings 
and were nearly significant (.08>p>.05) for five more ratings. Those items 

s 

whose ratings correlated with the expectation of graduating are indicated with 
asterisks (*) in Tables 5 and 6. In all twelve cases, the direction of the 
correlation indicated that those who expected to graduate were more critical 
of the program than were those who did not expect to graduate. 
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An examination of the crosstabulations of the responses to the question of 
whether the paraprofeSsional "fiad a teaching license or did or did not expect to 
get one soon, suggests a very similar pattern to that noted above. Those who 
expected to get their license were more positive about the program than were 
tJpse who did -not,, or who-were unsure about getting the license. An equally 
consistent pattern emerged from the crosstabulation with place of birth. Those 
born on the United States mainland (as opposed to those born" in- Puerto Rico op 
in a foreign country) were again regularly less positive in their ratings. 

Perhaps there is a tendency for those who are most sophisticated concerning 
the education system in general to be most critical of the program. Interest- 
ingly, however, this is not a function of familiarity or experience with the 
program itself. This may be a result of exposure^ to a larger number of alter- 
natives gained through greater education and experience, in other settings. 
Alternatively, those who have pushed ahead m?y be simply more independent and 
critical in their thinking m general , And, finally, the approaching achieve- 
ment of their own certification may have .led them to consider more carefully 
alternatives which they may want to adopt in their ov/n teaching in the future. 

SUMMARY . • 

While the educationally more- "sophisticated paraprofessionals tended to be 
somewhat more critical of a number of the program's aspects or activities, , 
this should not be interpreted as indicating that they were critical of the 
program iri general. As noted earlier, all ratings were quite high,-^so that 
the above statements compare favorable ratings with even more favorable ones. 
Another measure of the pa>aprofessionals* attitudes toward the program is their 
Response to item two, "If funds are available and you are eligible, would you 
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like to participate in the Bilingual Pupil Services Program netft year?" Al- 
though two respondents failed to answer this question, no one^answered "no."' 
As the questionnaires were completed anonymously, it seems unlikely that such 
* unanimity was coerced. .The program was clearly seen as a desirable place 
to work. And the final word should go to those who were most critical. Among 
those who expected to graduate, among those expecting to be licensed, and among 
•those born in the United, States, wlien asked to rate the overall quality of the 
program, in each case better than 85 percent answered, "excellent." 
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VII. FINDINGS 

ASSESSMENT PROCEDURES, INSTRUMENTS, AND FINDINGS 

The following section presents^the assessment instruments and procedures, 
and the results of the testing to evaluate student achievement in 1981 -1982. 

Students w§re assessed in English language development, growth in their 
mastery of their native f language, and mathematics. The following are the 
areas assessed and the instruments used: 
English Language Achievement 

- Interamerican series, Test of Oral Comprehension 
(Reading Readiness, Form C, Level 1). 

<> » 

- Interamerican series, Test of Reading 
(Total Reading, Form C, Levels 1,2,3) * 

- Interamerican series, Test of Reading and Number 
(Total Reading, Form D, Level 3) 

Native Language Achievement 

y * - Interamerican series, Prueba de Comprension Oral 

(Reading Readiness, Form C, Level 1) 



- Interamerican series, Prueba de Lectu ra, 
(Total Reading, Form C, Levels 1,2,3) 

-.Interamerican series, Prueba de Lectu ra y Numero 
(Total Readfng, Form D, Level 3) 



Mathematics Achievement 



Attendance 



Comprehensive Test of feasic Skills 

(Computation Subtest, Form S, Levels A,B,C,1,2,3) 



School and program records 
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On pre/post standardized achievement tests, statistical and educational 
significance are vreported. 

Statistical significance was determined through the application of the 
correlated t^-test model. This statistical analysis demonstrates whether the 
difference between pre-test and post-test mean scores is larqer than would 
be expected by chance variation alone; i.e. is statistically significant. 
This analysis does not represent* an estimate of how students would have per- 



formed in the absence of the program. No such estimate could be made because 
of the inapplicability of test norms for this population, and the unavailabil- 
ity of ,an appropriate comparison group. 



Educational significance was determined for each grade level by calculating 
an "effect size 1 ' based on observed summary statistics ^isincj the procedure 
recommended by Cohen*. An effect size for the correlated t-test model is an 
estimate in standard deviation units fre§d of the influence of sample size. 
It became desirable to establish such an estimate because substantial differences 
.that do exist frequently fail to reach statistical siqnif icance-if the number^- 
of observations for each unit of statistical analysis is small. Similarly, 
statistically significant differences often are not educationally, meani ngful. ' 

Jhus, statistical and educational significance permit a more meaningful / 
appraisal of project outcomes." As a rule of thumb, the following effect size 
indices are recommended by Cohen as guides to interpreting educational signi- 
ficance (ES) : 

a difference of 1/5 = .*20 = small ES 
a difference of 1/2 = .50 = medium ES 
a difference of 4/5 = .80 <= Jarge ES 



*Jacob Cohen. Statistical Power Analysis for the Behavioral Sciences 
(Revised Edition). New York: Academic Press, 1977 Chapter 2. 

-43- 

ERIC , ^ 



Information is also provided on the attendance rates of students by grade 
level and also by school. 



/ 



/ 
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TABLE 7 

Enqllsh Languaqe Reading Performance 

Significance of Mean Total Raw Score Differences * 
Between Initial and Fjnal Test Scores on the 
Interamerlcan Series Oral Cowgrchcnslon Test (*0C}, Form C f 
Interamerlcan Series Reading Test l»*R)t Form C, and 
Interamerlcan Series Test of RcaTlng and Number (***RN), Form 0, 
By Level and Grade. 





Test 


Aevel 


Grade 


N 


Pre-test 
Mean SO 


Post- 
Mean 


test 

SD 


Difference 
Of Means 


Pre/Post 
Correlation 


T-Test 


Level of 
Significance 


Educational f/ 
Significance 

Q 




* 


OCI 


1 


301 


24.2 


7.1 


30.2 


4.4 


6.0 


.52 


16.56 


.001 


0.95 




** 


Rl 


2 


342 


31.4 


17*6 


56.2 


18.7 


24.7 


.59 


27.67 


.001 


' 1.50 


1 


** 


R2\>^, 


3 


239 


43.4 


19.9 


60.1 


21.3 


16.7 


176 


17.89 


J .001 


1.16 


cn 
i 


*** 




Ik 4 


203 


23.6 


11.4 


33.7 


9.9 


10.1 


.60 


15.09 


.oot 


1.06 ~ 




** 


R3 1 ^ 




37 


28.9 


16.7 


35.8 


15.4 


6.9 


.82 


4.34 


.001 


0.71 




** 


R3 N 




145 


26.3 


14.9 


33.6 


19.7 


7.3 


' .47 


4.82 


.001 


0.40 



The following results ar^Xfor pupils who had four or fewer months of Instruction In the program and were pre* and post-tested In the spring. 



** R2 
*** RN3 
** R3 



19.6 


66.0 


21.7 


21.2 


.76. 


8.24 


• 001 


11.1 


32.4 


9.7 


0.8 


.76 


Q. 62 


NS 


18.7 


24.8 


10.4 


4.3 > 


.23 


0.89 


NS 



1.46 
0.11 

0.22 



. Students with a full year of Instruction demonstrated statistically significant growth In all grades. 

. Students In grades one through fbuK^had average gains ranglnq from 6.0 to 24.7 points and of large 
• educational s 1 gnlHoance"; s . 



. Among students with less than half a year of Instruction In the program, the third graders had statistically slqnlflcant <ta1ns of large 
educational significance, while fourth and fifth graders did not Ihov^tatlstlcally significant gains. In the case of the fourth grade, 
celling effects due to\ high pre-test score partly explains the Small gain. 
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TABLE 8 

Spanish Lanquage Reading Performance 
Significance of Hean Total Raw Score Differences Between Initial and Final Test Scores on the 
Interamerlcan Series Prueba de Comprens Ion Oral (*C0), Form C. 
Interamerlcan Series Prueba de Lectura ("Lj.Torm C, and \ t 

Interamerlcan Series Prueba de Lectura V Humero (***LN), Form D 
By Level and Grade. ' " 



; Te^ll Level 



Grade 



P re-test 
Mean sn 



Post -test 
Hean SD 



Difference 
Of Neans 



Pre/ Post 
Correlation 



T-Test 



Level of 
Significance 



Educational 
vStgnlf Icance 





ecu 


1 


301 


27.8 


5.4 


31.5 


4.5 


3.7 


.24 


10.35 


" 5 

***** 


* 


2 
3 


342 
238 


40.3 
46.4 


19.4 
19.6 


61.4 

64.0 


17.5 
21.8 


21.1 
17.6 


.61 
.79 


23.63 
20.23 


*** 


LN3 


H. 


203 


26.6 


9.7 


34.1 


9.0 


7.5 


.56 


12.17 


** 


L3 






/ 28.8 

/ 

' 33.3 


14.3 


38.2 


13.2 


* 9.3 


. .80 


6.48 


** 


L3* f 


6 


■ ^ 145 


14.4 


43.3 


22.0 


10.0 


.60 


6.82 





The following results are "for pupils who had four or fewer months of Instruction In the program and were pre- and post- tested In the 



spring. 



** L2 
*** LJU 
** L3 



32 
33 
16 



51.3 
36.8 
31.3^ 



20.3 
7.8 

13^1 



67.2 
29.7 
37.8 



21.7 
10.4 

15.5 



15.8 
-7.1 

6*5 



.73 
.53 
.72 



5.82 
-4.50 
2.38 



.001 
.001 
.016 



1.03 
0.78 
0.60 



Students with a full year of Instruction demonstrated gains ranging from 3.7 to 21.1 points which were statistically significant^ 
Students In grades two through five had average gains of large educational significance. 
Students In grades one and six had average gains df medium educational significance. 

IJIcint 



11y significant 
of 7.1 points. 



Of students with less than half a year of' Instruction In the program, the third and fifth grades 'tfj"'!*" 1 
# gains orSdlua to ^large Sducatlonil significance while the fourth graders showed^ statistically significant loss 

Note: Students with less than half a year of Instruction In the program composed single classes in fJ((M spools. 5 a J^ h a "J e lL t 
could be due to teacher effects and/or testing effects. In the case of the fourth graders, celling effects due to high pre test 
scores may partly explain the loss of points. 
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TABLE 9 

Mathematics Performance V 
Significance of Mean Total Raw Score Differences Between Initial and Final Test Scores on the 
* » Comprehensive Test of Basic Skills , Compilation Subtest, Form S,/» 

, By Level' and 6rade * 







r 




Pre- test 


Post-test 


01 t ference m Pre/Post^ 


Level of 


Educational 


Test & Level 


Grade 


N 


M^fn SD 


Mean SD 


- Of Means Xorrelatlon 


T-Test Significance 

-* n 


Significance 



\ 



A 


1 


301 


13.1 


4.9* 


20.3 


-9.7 


7.2 




.37- 


25.16 


.001 


1.45 


























B 


2 


341* 


17.3 


8.1 


25.9 


6.9 * 


8.* 




^0 


20.8& ' 


.001 


1.13 


C 


3* 


239 


18.7 


7.2 


24.0 


4.9. 


5.3 




.50 


13.05 


,001 


0.84 ; 


1 


4 


203 , 


26.5 


12.1 


37.8 


9.7 


11.3 




.51 


14.67* 


.001 


1.03 


2 

• 


5 


37 


24J 


9.0' 


30.7 


8.9 


6.0 




.53 


4.17 


. *O01 ' 


0.69 


3 


6 


145 


12.2 


5.1 


20.2 




8.0 




.39 


13.53 


.001 


1.12 


The following 


results are for pupllsjrfic 


) had four or fewer months of Instruction In the proqram and were pre- and post- 


tested In the sprlnq. 


t 


3 


32 


2i;2 


6.7 


23.6 


3.6 


2.4 , 




.42 


2.25 


.016 


0.40 


1 


4 


33 


4.8 


8.4- 


39.5 


7.5 


-0.3 




.71 


-0.31 




-0.05 


2 


5 




26.8 


10.8 


29.9 


9.8 


3.1 




.51 


1.23 


NS 


^,31 





























. Students with a full year of Instruction demonstrated gains ranglnq from 5.3 to 11.3 points which were statistically significant. 

• Students .In qrades one through four and six had average gains *of larqe educational significance. 

. Of students with less tfmrlialf a year of Instruction In the program, the third graders showed 1 statistically slqnlflcant qalns of small 
to medium educatlpfMiT^Tgnlflcance. The fourth and fifth graders did not demonstrate a statistically significant change. 
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TABLE 10 

Student Attendance Rates by Grade Level 





Grade 


Number of Students 


Attendance Rate 


Standard Deviation 


1 


t 

301 


• 87 


10.2 


2 


342 


89 


8.5 


•j 

0 


279 


89 


10.8 


4 
5 


243 

v. 

53 


92 
90 


7.4 
9.4 


6 


145 


90 


12.2 


• 


Attendance rates were essentially similar across all grade levels. 
The attendance rates were fairly high. 
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TABLE 11 

Student Attendance Rates by School 





School 


No. of Students 


Attendance Rates » 


Standard Deviation 
¥ 


P.S. 28M 


83 


91 


6.4 


P.S. 72M 


54 


91 


5.7 


P.S. 98M 


101 


90 


8.3 


P.S. 112M 


54 


90 


8.3 


P.S. 145M 


35 


92 


' 5.8 


P.S. 155M 


40 


88 


11.1 


P.S. 163M 


76 


91 


12.6 


P.S. 192M 


107 


93 


9.4 


P.S. 25X 


37 


90 


9.7 


P.S. 60X 


' 88 


87 


/ll. 3 


P.S. 65X 


42 


91 


6.7 


I.S. 74X 


33 


85 


10.3 - 


P.S. 77X 


49 


90 


7.3 


P.S. 79X 


44 


87 


10.6 


P.S. 90X 


55 


90 


. 8.0^ 


P.S. 114X 


78 


86 


10.9 


P.S. 130X 


39 


88 


10.7 


P.S. 211X 


55 


82 


16.0 


P.S. IK 


59 


89 


9.7 


P.S. 120K 


37 


86 


11.2 


P.S. 123K 


19 


94. 


^6.6 
^7.7 


P.S. 133K 


52 


89 


P.S. 155K 


76 


89. 


10.2 


P.S. 189K 


53 


92 


6.0 


Total 


• 1,366 


89 


9.8 



• Attendance rates by school ranged from 82 percent to 94 percent. 

. Although attendance rates by grade were essential ly* similar, rates~by ' 
school varied somewhat. 

. Due to uneven numbers of students, caution should be exercised when 
comparing attendance rates of different schools. 



VIII. CONCLUSIONS AND RECOMMENDATIONS 

In the course of gathering information for this report the evaluator spent < 
many hours interviewing various>members of the B.P.S. project its director, 
assistant directpr, and paraprofessionals and district personnel school 
principals, teachers, and directors^ of district bilingual programs. In every 
instance the evaluator found a sense among those interviewed that this project 
has made a contribution in the instructional p/ogfams of the participating - 
schools and to the preparation and conversion Sf paraprofessionals into teachers. 

In a complex school system like New York City's it is extremely difficult 
to sustain from year to year those elements of a centrally controlled project 
which are intended to foster a change in individuals and in methodology •« The 
B.P.S. project had been able, to a large extent, to remain basically unchanged 
in structure and purpose. The project operations reflect the maturity that 
ccmes from functioning for a number of years. The project has been able to 
continue its effectiveness through the talented staff that currently provides 
leadership and direction to the project. There is ample evidence of sound 
management practice, careful supervision, thorough record keeping, well planned 
training, and close cooperation and coordination. 

In the opinion' of the evaluator, essential to any centrally administered 
project is the liaison arrangement that is established and maintained between 
the'central office and the participating schools. The F.'I.S.'s have provided 
this link for the B.P.S. project and have established good rapport with many 
parties within the project and with school personnel. 



Since 1972, the B.P.S. project has consistently achieved its two major 
goals — increased. L.E.P. student achievement in reading and mathematics; and 
preparation of paraprofessionals to function effectively as teachers of LEP 
students. Jn reviewing pupil performance on standardized tests during the 
past three.years, statisticallyjsignificant gains have consistently been 
achieved by students receiving a full year of treatment at all grades in all 
areas assessed. > Post-test scores have often been outstanding; pre-test scores 
have sometimes been high enough to create ceiling effect?. * 

With regard to the latter goal, since 1972, 782 B.P.S. paraprofessional s 
have earned their baccalaureate degrees and the majority have enured the 
teaching p'rofession. In addition, paraprofessionals' responses to question- 
naire items on various programmatic aspects indicate that they rated the B.P.S. 
proj-ect as ranging between good and excellent in achieving its training ob- 
jectives. Also a measure of the B.P.S. project ' s success is the consistency 
with which evaluators have judged various programmatic activities as appro- 
priate for achieving program objectives. 

While numerous elements contribute to the success of the B.P.S. project 
in achieving its goals, three factors appear to figuHfc prominently: (1) 
effective program management; (2) pedagogical staff competence; and (3) para- 
professionals 1 receptivity to training and commitment to teaching L.E.P. stu- 
dents. * * 

The process of managing and coordinating a program within twenty-four 
schools dispersed throughout New York City is a formidable task. Clearly 
delineated staff responsibilities regarding training and supervisi^ of para- 
professionals, specific work/training requirements for paraprofessionals, 
clearly stated program procedures, and well -articulated feedback and documen- 



tation system, contributed to the B.P.S. projects ability to accomplish its 
qoals and qenerated an exemplary model of multiple site program management, 

Pedaqoqical staff competence was another salient feature of the'B.P.S. 
project. The results of interviews with program staff, analysis of parapro- 
fession|(fcs' questionnaire responses, and a review of curriculum materials 
developed by project staff provided ample evidence of a highly skilled staff 
with expertise in diverse educational areas. The employment of a diversified, 
highly qualified pedagogical staff represents a major strength of the B.P.S. 
project. . \^ 

In additiorr, two vital factors & the success of the ff.Pjfs. proqram are 
the paraprofessionals 1 commitment to teachinq L.E.P. students and receptivity 
p to traininq. These qualities were manifested in the paraprofessionals' care- 
ful planninq and presentation of lessons, development af supplementary teachinq 
materials incorporating students' interests, their involvement in special 
class projects, and willinqness to apply teaching suqgestions offered by the 
Ffeld Instructional Specialists and the master teachers. Without doubt, the 
paraprofessionals make a major contribution to the success of the instructional 
component of the B.P.S. project. ^ 





u 

RECOMMENDATIONS' 

1. It is recommended that the training of paraprofessionals include 

greater emphasis on teaching strategies aimed at developing higher level 

* * 
thinking skills in students. In this connection, Bloom's taxonomy of 

cognitive skills may be used as a reference in training paraprofessionals 

to develop comprehension questions which require progressively more complex 

cognitive functions. 

2. Although all paraprofessionals gave high ratings to the program^ training 
activities, the more experienced paraprofessionals those who were about to 
complete the trai^vg^frogram)-- tended %o be more critical. The program staff 
should consider the specif ic^craining needs of tKis more sophisticated group 
and determine how their training program should be mq^Hfied. * 

3. It is recommended that the program make every effort to limit the 
number of students that a paraprof essi onal is assigned to teach at any one 
time to eight. Such a step would help in providing LEP students greater 
individual attention. 

4. Improved coordination between the B.P.S. program and the colleges 
attended by paraprofessionals may help to meet participants' existing 
educational needs. A staff member should be assigned to serve as liaison * 
between the B.P.S. project and the colleges. 

5. Given^the success of the B.P.S. program model, it is? recommended 
that .the project director seek to extend project services to LEP students 
in other language groups, e.g. Chi nese, 'French/Creol e, Korean,. Greek, etc. 



k Bloom, B.S., et al. Taxonomy of educational objectives, handbook 1\ 
. Cognitive domain . New, York: McKay,, 1956. ] ] ~ 
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Bilingual Pupil Services 
131 Livingston Street , 5th Floor 
Brooklyn, Hew York 11201 



APPENDIX A 



FORMAL LESSON EVALUATION FORM 



ame 



Subject/Language^ 



School/ Grade 



Date 



LESSON ASPECTS 



A* Objective: 



well stated 
appropriate 
realized 



COMMENTS 




B. Motivation: 



creative 
effective 
interesting 
related to pupil 1 s 
experiences 



C. Lesson Development: 



sequential 
well developed 
final summary 



D. Questioning: 



well worded 
sequential 
medial summary 
pivotal* 
challenging 



rials: 



suitable 
creative 
teacher-made 
multi-purposed 



ERIC 



T. Follow-up and Evaluation: 



appropriate 

related 

effective 

interesting 

continuous 
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i 



6. Techniques ; 



student -dominated 

iesson. 
teacher-dominated 

lesson; 
control jof group 
use of /time 
Adhere* to plan 
adapts to needs 



The fo^Loying sca^e vi^/be used to rate areas II and III. 

5-outstan4i£g . t-^ood 3-average . 2-needs improvement l-unsatisfactory 




OVERALL ASPECTS 



J 



COMMENTS 



organized < 
sensitive to needs 
rapport 

motivates effectively 
code-switching 
proper use of language 
resourcefulness 
voice, speech, diction 
9 poise 
personal appearance 



:ii. 



Lesson Rating: , 



Field Instructional Specialist 



have read and received a copy of this evaluation- 



Educational Asst./ Assoc. 



Approved :_ 



Project Director 
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THE CITY SCHOOL DISTRICT OF NEW YORK 
131 LIVINGSTON STREET, STH FLOOR 
' BROOKLYN, NEW YORK 11201 
OFFICE OF BILINGUAL EDUCATION 
BILINGUAL PUPIL SERVICES 



PARAFRO FESSIONAL EVALUATION FORM FOR PERIOD COVERING 
Name of Paraprofessional 



LAST 

Position Held: Educational Assistant 



FIRST 

Educational^ Associate 



School 

Cooperating Teacher 



District 



Grade 



Please JT ate t ^ e paraprofessional using the following scale: 
1-needs improvement 2 -has shown improvement: S-fai^ 



\ 



tf-good 



5-excelleri 



— 

1. Fafc^pjofei 



erpersonal Relations . 



Rating 



Comments 



essional f s rapport with: 
a* pupils 

b. cpoperating teacher 

c. school staff * 



2. Flans and prepares work with 
cooperating teacher: 



3. Understands role of teacher /para- 
professional' in the classroom: 



U*. Facilitates positive group 
interaction: 



" Evidence of Commitment 



B-. 



Rating 



1. Adapts instruction to the individual 
needs and capacities fc of pupils : 



2. Hakes class instructional program 
interesting to pupils: 

_L 



3. Enriches and supplements the physical 
environment of class: 



9 
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* . Shows initiative in obtaining or 

isaking Materials f and doing re- 
search for the effective teach* 
ing of his/her lessons: 


• 


, - A • 

* / 

y - v 
' " \ « 

\ 


5. Demonstrates ability to &Lan and 
organize learning situations: 

\ 






C. Professional Potential\ 


Rating 


\ Comments 


, ■ 1 \ 

1. Demonstrates ability to assume 
responsibility: 




\ 


2. Shows initiative and resourcefulness 
in developing his/her own teacnV 
ing style: \ \ 

V- v- 


• 

* 




3. Is able to accept constructive ^ 
criticism ^ 


• 




**. Attendance 

4 






S. Punctuality 




: V— 


6. Oral language proficiency: 
English 

• 

Spqpish 

^ 1 U_ 






7. Written language proficiency: \ 
\^ English r 
Spanish 


• 


\ : — 


8. Growth in teaching abilities: 

t 







\ 
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Piease provide additional comments on the paraprofessional'a overall 
.performance and potential for teaching. 



\ 



A 



Date 



Cooperating^ Teacher 1 s Signature 

/ 
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*Revised Kay 19, 1980 



Bilingual Coordinator and/or Principal's 
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THE CtTT SCHOOL DISTRICT Or NO* YORK APPENDIX B 

tSl UVINGSTON STREET, SROOKUYN. NEW YORK !t*Ot ' 
OFFICE OF SI UNGUAL COUCAtlON 

BILINGUAL PUPIL SERVICES v 

ROOM SIS 
S22.SS41 

AWIVOAORTA CEUA KU DELGADO 



•iftfCTM "*\ 



PWOJCCT DlftCCTO* 



Dear 



Your appointment with the screening panel of the program, Bilingual^ 
Pupil Services, has been scheduled for ; at. 



You will be required to do the* following: 

i # Take a written short .answer test in English. 

2. Write a composition in English. 
Write a composition in Spanish. 

H. Take an oral interview in both Spanish and English. 
<5. BRING A COPY OF YOUR COLLEGE TRANSCRIPT. Without it 
the screening and interview cannot be done. Verifi- 
cation of your college credentials is necessary. 

6. Change to Evening Session College since the position 
with our program is'from 8:H5 a.m. to** 3:00 p.m. 

It is important that the screening date be kept. Our waiting 
lists are very long. If you cannot come for the scheduled screening . date, 
you name will be* placed at the end of the roster. The entire screening 
procedure may take up to six (6) hours. .Please make arrangements to re- 
main the whole day. ^ 

Thank you for your interest in our program. ' % 

Sincerely, 

" v Celia M. Delgado v 

* Project Director 

CMD:ms ' 
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•> TH% CITY SCHOOL DISTRJCT OF NEW YORK 

131 LIVINGSTON STREET* 1RO0KLYN, NEW YORK It 201 
OFFICE OF VI UNGUAL EDUCATION ^ 

" ' BiLTNGtJAX PUPIL SERVICES 

ROOM 8t2 



0 



CEUA H. DELGAOO 
PHOJICT oircctok 



Dear 



We have evaluated your screening examination and find .that, you 
must improve in the areas^ listed below before you can be accepted 
into the program: , * 



Michigan Test of Eng. 
Language Proficiency _ 
Written English 
Oral English 
Written Spanish 
Oral. Spanish 
College Performance 



You may request to be rescreened one year from the date you 
applied. 

Should you have any questions, please do not hesitate to call 
our office. * 

* Sincerely, v r 



Zelia M. Delgado ' 



Celia M. Delgad 
Project Director 



ms 
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THC GXVf SCHOOL DISTRICT Of, NCW YORK 

i3i uviAgston sntcnv Brooklyn, ncw yowc ttzot 

QFWICZ OF Bl UNGUAL EDUCATION 

BUJNGOAL PUPIL SERVICES 

ROOM ft* ' 



Date 



Dear 



The Bilingual Pupil Services Program is pleased to in- 
form you tl^t you have been accepted for the position 



of 



He look forward to your participation' in our program 
and hope it will be a rewarding experience for you and 
the children. 

r ' ftofild you please come to, our 

- V ^ - - office f aaPsoon as possible 

* to complete payroll forms ♦ 

you please call our 
to make an appointment 
to come and meet with your 
Field Instructional Specialist* ^ 

j_ * Your name has been put on our 

f • .waiting list. You will be 
notified to* fill the -next * 
• available position. 

If you have any questions , pleh^e do not hesitate to 
.contact me at the above telephone number. 



Sincerely, 




CMDrms ~* 
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Celia M. Delgado 
Project Director 

# ^ < 



-131 LIVINGSTON S TRE ET t BROOKLYN, NEW YORK 11291 
- OFFICE OF BILINGUAL EDUCATION 



BILINGUAL PUPIL SERVICES 



COMMITMENT FORM FOR ADMISSION 
TO BILINGUAL PUPIL SERVICES 
SERVING ELIGIBLE CHILDREN IN TITLE I PROGRAMS 



ROTE: 

The following commitment is requested by the State Education 
Department and the Board of .Education as a requirement for talcing * 
part in the training program component of the project cited above • * 
Applicants are asked not -to* sign the form unless they definitely - 
plan to adhere to the commitment as stated below. Approval of the • 
proposal by the State Education Department, Title I Office, is 
based on adherence by applicants to this commitment . Nonadherence 
to tiie commitment places f u t u re funding of the proposal in jeopardy • 
* " ■ . . % 

; Signed 

r • . Celia M. Delgad? ' 

Project Director 



Bate 



It ^ j hereby agree that after receiving " 

training from this project, I will undertake to teach or otherwise 
serve in a Title I E.S*£.A« program to meet the etflfcational needs 
of non-English-speaking children. 



ms 
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NKW YORK Cm 1 FVBUC SCHOOLS 

OFFICE OF BILINGUAL EDUCATION 

AVtLDA ORTA 
DIRECTOR 

CENTER FOR STAFF DEVELOPMENT 
SUPPORTIVE AND INSTRUCTIONAL SERVICES 

BILINGUAL PUPIL SERVICES 

CELIA M, DELGADO 
k PROJECT DOUCCTOR 



, APPENDIX C 



PEDAGOGICAL STAFF DEVELOPMENT . WORKSHOPS 



Calendar 



September 



17 O.B.E. Goals and Objectives fdr FY 1981-1982 

18 Prototional Gates Information 



October ^ 

' 30 ESL and Language Learning Through The Arts 



November 
5 

20,24 
25 



> ^ 

E^^uStion and Testing 

Managerial Training Workshop - Level I 

Managerial Training -Workshop - Level tl 



Deoentoer 

16 

. 10 



Managerial Training Workshop - Level HI -« 
Open Court: Real Math Workshop I 



January 



14,15,29 



Educatiorlal Law 
Innovative Trends in Evaluation: Ccnputer Technology 



er|c 



131 LIVINGSTON STREET ' 



s 



ROOM * BROOKLYN. NEW YORK 11S01 • 528**41 
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• February 
17 

19 ■ 



"O.3.E. Conference: Concerns in Bilingual Education 
Open Court: Real Mat2i Workshop IX 



March 
19,10 

19 

. April 
None Held 



C.C.N.Y. Conference-Building on the Strengths of 
Children: Culture and Comnunication 

E.S.L. Workshop: British Maest ri Han Go. 



May_ 
7 

14 



Racial and Sex Stereo-Typing in Textbooks 
O.B.E. Conference 



9 
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SR* YllKhCtTY FVni.lCHCHUOlA 

OFFICE OF BILINGUAL EDUCATION 

AWILDA ORTA 
lltKFXTOW 

CENTER FOR STAFF DEVELOPMENT 
SUPPORTIVE AND IN^TRCCT!ONAL,SF.RVlCKS 

BILINGUAL PUPIL SERVICES 

CELIA M« DELCADO 
* >'tfOJKCT W1KECTOK 



IN-SERVICE COURSE SYLLABUS * 
Spring 1982 Semester 



Graduating B.P.S- Paraprof ess i onal s : 
Meeting the Special Needs of L.E^.P. Children 



General Object i ves : v , 

- To help participants develop basic elements for composition writing 
^(Spanish/English) in thei r students 

- To underline the continuous- use of English/Spanish grammar and J ts 
integration J nto other, areas of the curriculum. 

- To familiarize participants with changes in l) ASPIRA Consent Decree; 
2) mainstreaming of L.E. P.. except i onal child; 3) Bilingual Education 
laws; k) Promotional .Gates; 5) Motivation in a lesson. 

- To provide participants with creative ideas and materials for the 
development of bilingual instructional materials in bilingual read- 
ing/mathematics and E.S.L. 

- To suggest ways of integrating matt^Tnto other areas of the curricu- 
lum. 

- To expose participants to the bas'ic considerations for developing a 
diagnostic and prescriptive approach to reading. 

- To p/royyde participants with necessary information for the structure 
and implementation of learning centers. 

- To expose participants to the use ofjnedia in the classroom aj^a 
learning instrument. 

- To, provide participants wifch classroom management techniques and 
recordkeeping information. 

- T<^ provide participants with different methods of teaching E.S.L. 
and of its integration into other curriculum areas. 



131 LIVINGSTON STREET 



ROOM 512 

- 66. 



BROOKLYN, NEW YORK 1 1201 
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Session &\ - February 8, 1982 

Topic: Improving Writing Skills in 
Engl i sh/Spani sh 

Time: 9:00-12:00 

Topic: Composition-Content and 
Timing 

Time: 1:00-3:00 



Instructors: Lisandro Garcia-Marchi 
Dahlma Llanos 



Instructor: Julio Pedraja 



>ssion #2 - February 22, 1982 

Popic: Key Grammatical Considerations Instructor: Yvette Hordof fc 
J in English/Spanish , - 

> 

Time: 9:00-12:00 

Topic: Integrating Writing (Engl ish/ Instructor: Fernando Crespo 
Spanish) into other Areas of 
- the Curriculum > 

Time: 1:00-3:00 " — — . 



Session #3 - March 1 , 1982 

Topic: Culture as Part of the E.S.L. 
Curriculum 

Time: . $:00-12:00 

Top'ic: Sample Topics for Creative 
Writina Activities „ 



Instructor: Eugenia L. Montalvo 



Instrtfcton: Miriam Moreno 



Time: 1 :00-3:00 



Session ik - March 8, 1982 

Topic: The Use of Role-playing and 
Puppetry In E.S.L. Instruc- 
tion 

Time: 9:00-3:00 



Instructor: Yvette Hordof 



V 
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Session §5 - March 15, 1982 



Topic: Structure and Implementation 
of Learning Centers: Develop- 
ment of Bilingual Reading/ 
Mathematics Material 

Time: 9:00-3:00 



I nstructors : 



Jul io Pedraja 

Si lvKa Buzzorvetti 



Session *6 - March 22, 1982 

Topic: Informal Testing-Math and 
Math Grouping, Classroom 
Management 

Time: 9:00-3:00 



I nst ructor; I sabel Rios 



Session *7 - March 29, 1982 

Topic: Bas ic . Cons i derat ions for 
Developing a Diagnostic 
and Prescriptive Approach 
to Readjng 

Time: 9:00-12:00 



Instructor- Luisa P. Fuentes 



Topi c: 



Word Recognition and Com- 
prehension Ski 1 ls;Develop- 
ing/Administering an informal 
reading inventory 



Time: 1:00-3:00 



Instructor: Luisa P. Fuentes 



Session £8 - April 5, 1982 

Topic: The use of media in the 
classroom: A media 
Expe r ience 

Time: 9:00-3:00 



I nstructors; 



/ 



Cel ia M. Delgado 
Julio Pedraja 
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Session *9 - May 3,. 1g32 



Topic: 

Time: 
Topi c: 



Classroom Management and 
Recordkeeping 

9:00-12:00 



Important Information on: 
1) ASP IRA Consent Decree; 
Mai nst rear, i ng of the 
I . E . P . except i ona 1 ch i Id; 
Bili ngua 1 Education laws ; 
Promotional Gates; 



2) 
3) 

k) 

5) Motivation in a lesson 



Instructor: Fernando Crespo 



I nstructor : Eugenia L, Montal vo 



Ti me: 



1 : 00-3:00 



Session #10 - May 17, 1982 

Topic: Development of Survival- Kits 
for teaching" Reading/Math/ 
ESL/Bi 1 i ngual writing 

Time: 9:00-3:00 / 



I nstructors : 



Celia M. Delgado 
Jul io Pedraja 
Si lvia Buzzonetti 
Fernando Crespo 
Eugenia I. Montalvo 
Mi riam Moreno 
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BILINGUAL 9UPIL SERVICES 



DISTRICT WORKSHOP ill 



Field Instructional Specialist: Silvia Buzzonetti 

* 

Date: October 2, 1981 ' 



DISTRICT 
23 



SCHOOL 



P<S. 155 



RO'OK 



Library Room 



TIME 



8:50-3:00 



c 



AGENDA 

I. Group dynamics Activity 
II. Programatic Matters 

A* Pre-test information 

1. test packets pick-up date October 9, 1981 
check packets in office ,mm 

2. -pre-test dates October 14, 15, 16 

3. test' packets due back at headquarters by 
October 23 , 1981 

B. Forms to be filled out 
*\ . 

1. schedule fqrm 

2* college data sheet 

3. target population sheet 

C. Daily Lesson Plans forms 

D. Programatja Protocol 1 

LUNCH . " 



ERIC 



III. B.P.S. Manual Qui2 

IV. Distribution of Handouts 

V. November* Workshop 

VI. Workshop Evaluation 
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BILINGUAL PUPIL SERVICES 



DISTRICT WORKSHOP j?l 

Field Instructional Specialist: Fernando Crespo 
Date: October 2, 1981 

/ 

DISTRICT SCHOOL ROOM 

3 P.S. 163 220 

AGENDA 

I. Group Dynamics Activity 

II. Programatic. Matters 

A. .P re- test information , 

1. test packets ^ick-up date October 9, 1981 
check packets ~in office 
* " 2. pre-test dates October 14, 15, 16 

3. test packets due back 'at headquarters by 
. October 23, 1981 

^B. Forms to be filled out 

c 

1. schedule form • 

2. college data sheet . v 
, 3. target population sheet 

C* Daily Lesson Plans forms 

D. Programatic Protocol 

LUNCH ' 



III*. B.P.S. Manual Quiz 

" •IV. 'Distribution of Handouts 

V. November Workshop 

VI. Workshop Evaluation 



BILINGUAL PUPIL SERVICES 

4 



DISTRICT WORKSHOP fll 

Field Instructional Specialist: Eugenia L. Montalvo 
Date: October 2, 1981 

DISTRICT SCHOOL ROOM * 

10 P.S. 79 Library Room 

AGENDA 



I. Group Dynamics Activity* 
II. Programatic Matters 

A. Pre-test inf ormation 

t 1. test packets pick-up date October 9, 1981 

check packets in office 

2. pre-test dates October 14, 15, 16 

3. test packets due back at headquarters by 
October 23, 1981 

B. irorms to be filled out 

1. schedule form 

2. college data sheet 

3. target population sheet 

C. Daily Lesson- Plans forms 

D. Programatic Protocol 

LUNCH 

III. B.P^. .tlanual Quiz 

IV. Distribution of Handouts 

V. November Workshop \ 

VI. Workshop Evaluation , ^ 

• . "72- 8, 



BILINGUAL PUPIL SERVICES 



DISTRICT WORKSHOP ill 



Field Instructional Specialist; Miriam Moreno 
Date: October 2, 1981 

DISTRICT SCHOOL ROOM 

7 ; s P.S. 65 508 

/ 

AGENDA 

IS*' Group Dynamics Activity 

II. Programatic Matters 

A. Pre-test information 

1. test packets .pick-up date October 9, 1981 
check packets in office * • 

, 2. ' pre-test dates October 14, 15, 16 
3. test packets due back at headquarters by 
October 23, 1981 

✓ 

Forms to* be filled out. 

1. schedule form 

2. college data sheet 
3: target population sheet 

C. Daily Lesson Plasis forms \ • 

D. Programatic Proto&ol 

LUN Cf ' ' K , 

/ 

III. B.P.S. Manual Quiz 

IV. Distribution of Handouts 

V. November Workshop 

VI. Workshop Evaluation • 

-73- 1 
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BILINGUAL PUFIL SERVICES 



DISTRICT WCRKSkOP ^2 

Field Instructional Specialist: Fernando Crespo 
Date; November 6, 19 SI 



Air 



DISTRICT " ,. SCHOOL ROOM 'TIME 

2 ' . P. 5. 253 * 220 8:40-3:00 

s 

AGE i: xD A - 
. ; 

I. 'Group Dynamics^Activity (9:00: --10:00) 

I?. Pro'gramatic !4atters 

A. Title I Monitoring Visits -.Ms, Gay' Wainri,ght-Niang 
en November 23, 24, and 25, 1981 - \ v , 

3. Informal Observations - Jfeefe 0/ November 9 y and 16, 1981 

C. Formal Observations - Week of November *30, 1381 

D. Title I - Notebook 

- £. ^ Career Training Forms - Deadline Date: November 25, 1981- 

F. December Workshops ^ 

(7. Parents Conference - Saturday, November 21, 1981 

III. Guest Speaker: Professor Geraldo^Torres of C.C.N.Y. (10:00 - 21:00) 
Topic : Integrating Culture in^the Various <Curriculum Areas 

IV. Presentation by Paraprofessionals of P.S. 98, Dist^i (11:00 - 12:30) 
Theme : Puerto^Rican Heritage Activities: 



Taelma Guerra (11:00- 11:20) Ramona Garcia ^ (11:40 - 12:00) 

* Lillian Acevedo (11:20 , 11:40) . Rosa Garcia - (12:00 - 12:20Y 

LUNCH \ 

^ ^ v 

VJ^hlaterials Development (1:30 - 2:35) 



tf$T. Iforfcstop Evaluation/ Clean-Up (2>f30 3:<W 



/ ' BILINGUAL -PUPIL SERVICES 



DISTRICT WORKSHOP 112 

Field Instructional Specialist: Silvia Buzzonetti 

^ * 

Date: November 6, 1981 L T* 

DISTRICT SCHOOL ROOft TIME 

4 P.S. 72 501 • . 8:50'- 3:00 

AGENDA 

I. * Group Dynamics Activity - 9:00-9:30 ^ 
II. Programktic Matters -'9:30-10:00 

"I ' 4 

a) Title I Monitoring Visits - Ms, Gay Wainright-Niang 
on November 23, 24 and*25, 1981 

\< b) Informal observations - *Week of November 9 and 16, 1981* % 

c) Formal observations' - Week of*November 30, 1981 - 

^ -f >v^> : Title I Notebook I. . 

^ e) Career Training Forms - Deadline date - November 30, 1981 

f ) December Workshops 

g) ' Parents Conference - Saturday, November 21, 1981 

III,. Presentation by Paraprofessionals : 

fc P.S. 112 - Puerto Rico - Yesterday an^Today (10:-00-10:2Q) 

P.S.' 155 - D4 - Ethnic Foods in* the Curriculum. (10: 20-10: 40) ' 

• , P.S.' 189 - D1Z - Dramatizing folktales (10:40-11:00) r ' " 

P.S. 72 -'D4 - Taino. Indians (11:00-11:20) . , 

* '*. P.S. 155 - 'D23 - Integration o'f Culture into the 

. x ' Curriculum (11:20-11:40) 

P.S. 133 - D13 - Music and the Curriculum, (11:40-12:00) 

IV. LUN0H - (12:00-1:00)' " ' ' 

V. Materials development (1:00-2:30) 

VI. Distribution of handouts^ workshop evaluation, ' * * 

cleaning' up (2:30-3:00) * \ m 



BILINGUAL PUPIL SERVICES 



DISTRICT WORKSHOP P 2 



Field Instructional Specialist: Eugenia L. Montalvo 
Date: November.% 1981 



DISTRICT 



12 



SCHOOL 



C.S. 77 



ROOM 



307 



TIME 



8:40 - 3:00 



AG E N DA 



I. . Group Dynamic Activity 
II. > Prog ramatic Matters 



A. Title I Monitoring Visits. ^ Ms. Gay Wainvright-Niang.. •« 
on November 23, 24, and 25; 1981 A ■ , •' " 

B. Formal Observations -.Week of November 30. 

C. , Title I - Notebook # ^ 

D. Career- Training Forms - Deadline Date November 25 1 

• <* 
III. Paraprof essionals Presenting by Schools: 

Theme : , Puerto Rican Heritage Activities, (Den>onstration Lessons) 
»i]JNCH 

•» 

IV. Puerto Rican Heritage -Materials Development 

V, Distribution of Handouts ^ 

* • 1 

\ 

VI. > December .Workshop 

. . • ' * '> 

VII. WotkShop Evaluation \ 



3ILINGVAL SERVICES 



DISTRICT WORKSHOP $2 



0 



Field Instructional Specialist: Miriar Moreno 
Date: November 6, 1982 



DISTRICT 



SCHOOL 



P.S. 60 



ROOM 



262 



Tim. 



8:50 - 3:00 



A a 



c 1, 



I. Group Dynamics .(9:00-9:30) *(See attached) sheet) 
T. Puerto Rican Rentage Week Presentations: 
A. Poetry lesson • 



Onelia Colon 
Sonia Alicea 

* * 

Edgar do Figueroa 
Sara Gomez 

I-larga^ita Olivo 
k'iyuel A. Colon 

-llarta Lopez h 
Carina Cruz 

It$&z Fuehte's 
Leonor Galloway 



S. Geography lesson 
d Science, lesson 

D. Mathematics lesson * 

#■ 

E. Ihit^tiOn lesson 
LVNCg (12:00 - 1:00) . 

F. Art and Music lesson » Diorc<? Fe^a 

' Juanita. Torres 
Rosa Reyes 
\ Migdalia "Ramos • 

G. Materials Development' ' ' ■ 

Mathematics and Music Maria. Negron ^ 
lesson 



9:30 - 10:00 



10:00 - 10:30 



i0:30 - 11:00 
ll:00j- 11 :/2S 

'"' H:30'- lLtiO- 



1:00 - 2:00 



2:00 -^3:00 



Prccranazic Matters* 

A. Title I Monitoring Visits - Ate." Gay Wainrigkt-Niang . 
on November 23, 24-, and 25, 1981 

3. Informal Observations - Week of November 9, and 16, 1981 

C. formal Observations - Week of November SO, 1981 

2. Title I - Notebook 

I. Career Training Forms'. - Deadline Date: November 25, < 198V 

F. December Workshops 

ff. Parents Conference - Saturday, November 21, 1981 



f 
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BILINGUAL PUP I L SERVICES 



DISTRICT WORKSHOP #3 



Field Instructional Specialist: Miriam Moreno 
Date: December 11, 1 381 



W STRICT 



SCHOOL 



P.S. 60 



AGENDA* 




TIME 



8:50 - 3:00 



1. Group Dynamics Activity 
II. Prbgramattc Matters 

A . Forma 1 Observat i ons 

w . - - B. Assignments for future workshop 

III. ' Christmas Learning Centers 
IV. Materials Development Presentation 

X: Mdrta Lopez 

B. Rosa Reyes 

V. Christmas luncheon 
V I . Workshop eva 1 uat i on 
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'BILINGUAL PUPIL SERVICES 



DISTRICT WORKSHOP #3 



Field Instructional Specialist: Eugenia L. Montalvo 
.Date: December 11, 1981 y< 



DISTRICT 



12 



SCHOOL 



C.E.S. 211 



ROOM 



Science Room 



TIME 



8:50 - 3:00 



AGENDA 



"Group DynSfrics. Activity 
II. Pr ogr atria tic Matters 

A. Formal Observations 

B. Teacher Evaluation 

C. Attendance 

D. January Workshop 

E. Future Workshops 



III, 



Presentation: Integrating tl\e Holiday Season in the 
^ Curriculum Areas ' 



A. Introduction - Eugenia L. Montalvo 

B. Presentation -.Carmen De Loren20 * 

IV. LUN'CH 

~~" ~~" *~ * ^ * 

i 

V. ' Materials Development 
VI. Workshop Evaluation /Clean-Up' 



9 
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% BILINGUAL PUPIL SERVIGES 



DISTRICT WORKSHOP #3 



Field Instructional Specialist: Silvia Buzzdnetti 



-Date: December 11, 1981 

♦ 



DISTR 



42 



ADDRESS 



•131 Livingston St. 



ROOM 

5th floor 
Conference Area 



AGENDA 



I. Group Dynamics Activity (9:00 - 9:15) 
It. Programatic Matters - (9:15 - 10:00)' 

1. Formal Observations 

2. Attendance 



3. January Workshop 



TIME 



9:0(5 - 3:00 



III. Presentation - Integrating the theme of "thristmas " 

, ' into the Curriculum (10:00 - 12:0,0) 



5. Music 

6. Creative Writing 
<7. Art 



1. Reading * 

2. '.Math 

ft* 

3. Social Studies 
• t 4. E.S.L. 

IV. L'U N C ff (12:00 - 1:00) 
V. Materials Development (1:00 - 2:243) 
VI. Workshop Evaluatioh/Clean-Up (2:,45 - 3:00') 



9 
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BILINGUAL PUPIL SERVICES 



DISTRICT WORKSHOP #3 



Field Instructional Specialist: Fernando prespo 
Date: December H 1 , 1981 



DISTRI/CT 
3 



SCHOOL 



P.S. 163 



ROOM 



220 



TIME 
°{:50 - 3:00 



AGENDA 



. f. jsi-oup Dynamics Activity (9;00 - 9:15) 



II 



PrograifatTc'''Matters ' - '{9:15- *10:tf0) 



A. ' Formal Observations 
8. Attendance 
C. v January Workshop 



III. Presentation : Integrating the Holiday Season in 

the Curriculum Areas ( 10 TOO - 12:00) 

• * * « 

< A. Introduction: m ] * 

1. Fernando Crespo - Field Instructional Specialist 

- B. Presentations:- * , ^ 

* 1. Lorenzo Garcia - Educatibnal Assistant 

2. DolTy Garcia - Educational Assistant 
^r+s Angel Seise - Educational Assistant 

Iti. LUNCH (12:00 - 1:00)* 
V. Materials Development * (1:00 - 2:30) 
VI, Workshop evaluations/Cleanup (2:30- 3:00) 



BILINGUAL PUPIL SERVICES 



DISTRICT WORKSHOP ft 

0 

* 

V , - 

Field Instructional Specialist: Miriam Moreno /^'y 
Date: January 8, 1982 

DISTRICT SCHOOL 1 ROOM 

8 P.S. 130 ' 32$ 



AGENDA 



tlw Group .J>ynamic|[ (9:00 •? 9:30) 

II. Operating Ytatft^Camera (9:30 '-"lOiOO) y> -v * 

a. ' holding your camera properly 
v b. film speed 

c. shutter speed 

d. m lens opening 

e. focusv ' * 

f. F- stop - „ 

g. J loading the camera 

III. Using the Camara (10 - 10:30) . 

1^. Developing^the Negatives (10:30 *• 11:30) 

* a. materials needed? 

charing bag,, developing tank, can-opener, 
- D-7S developer ^(HC 110), stop bath, fixer, 
— scissors, funnels, graduates , thermometer 

^ f $* * 

. b. mixing the chemicals - temperature^ actor 

c. loading the negatives 

d. . developing negatives - time factor 




V. Printing Black and White 

a. mixing chemicals 

b. contact sheet 

c. test strip % 

d. timing 

* 

VI. LUNCH (12:00 - ,1:00) 

mmm — — mm - —mm ' «"i 

v^Vll. Developing Rriats and Question and Answer 

# # » 

VIII. .Workshop Evaluation (2:45 - -3:00) j 



Period (1:00 - 2:45) 



9 
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BILINGUAL PUPIL SERVICES 



DISTRICT WORKSHOP #4 

Field Instructional Specialist: Eugenia L. Montalvo C/fa. 
Date: January 22, 1932 



DISTRICT 



12 



SCHOOL 



C.S.S; 211 



ROOM 



Teachers Room 



\ 

TIME 
8:40 - 3;00 



AGENDA 

* 

I. Group' Dynamics (9:00 - 9:30} 
II. Operating- Your Camera (9:30 - 10:00) 



hb3,dihg yc$ : i&ia&*h ^propeirly 

^'b. film v speed 

c. shutter speed 

d. lens opening 

e. focus 

f . P- stop 

g. loading the camera 



III. Using the Canera (10:00 - 10:30) 
IV. Oevejtotfihg the Negatives .(10:30 - 11:30) ' 
a. 



materials needed: 
changing bag, developing tank, can-opener , 
0-76 developer (HC 110) , stop bath, fixer, 
scissors r funnels, graduates, thermometer 



b. mixing the chemicals - tenperature factor 

c. loading the negatives 

d. developing negatives - time factor 

l 



■ * t 
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' V, Hew to Print Black and White 

• « 
a* , fixing * cha*ni'cals ■ ' 

b. contact sheet . c 

c. test strip 

d. tiding 

VI., LUNCH ^ ' (12:09 - 1:09) 
VII. Developing Prints and Question and Answer Period 



Bibliography 



The Basic Book of Photography 
By Tom Griitm 1 
New American Library * 



Julio ' " 

Aida Res to 
Margarita Perez ^ 
Angelo Monserrate 
Edna Montafiiez ^ 



Groups , 

- Sxlvia 

Awildd Andino 
Carmen Castro 
.Benecia Gonzalez 
Carmen DeLorenzo 
Maria Serrano ' 



^ xJegsica 

Miriam Santiago 
-Loyda Rodriguez 
Carmen Cardona 
Angela Cintrpn 
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BILINGUAL PUPIL SERVICES 



„ DISTRICT WORKSHOP #4 



"Field Instructional Specialist: .Fernando Crespo 
Date:- January?, 1982 



DISTRICT 



SCHOOL 
P-.S. 163 



A G E N 



ROOM 



220. 



D A 



TIME 



8 :5G-3:00 



A. 
B. 
C. 

•D." 



I. Groups Dynamics Activity (9:00-9:30) ' *' 

II. Programatic Matters (9:30-10:00) 

£ield Visits v # 

Formal Observations . 

-Future Workshop? ^ „ ^ \ v. t - * m - * * ' : 

Payroll < a " * ^ ~ ^ ' - 

* \ 1- Due Jan. 12,->1982 , 

E. Checks" -~ - 

* 1- January 14/ 1982 
J\ ' Time Cards 

1- Will not be paid if time is not entered 

G. Teacher Evaluations 

III. Presentation of' materials developed by paraproiessionals 
- * . (10:00-11:30) 

IV. Distribution pf Handouts (11:30-12:00) t 

V. Clean up/Set up for Lunch ( 12 :'00-12 : 30) . *' ' . 

VI. -NEW YEAR*' S LUNCHEON (12:30-2:00) 

VII. Cleanup ( 2": 00-2 : 30 ) • 

VIII. Workshop Evaluation (2:30-3:00) V" 
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* BILINGUAL PUPIL SERVICES 



DISTRICT WORKSHOP H 



Field Instructional Specialist: Silvia Buzzonetti 
Date.; January 29,-1982 , ' 



DISTRI 



12 



SCHOOL 



C.E.S. 211 



ROOM 



Teacher's Room 



TIME 



8:40 - 3:00 



\ 



AGENDA 



I. Group Dynamics C8:40 9:15) 
II.' Operating Your Camera C9:15 - 10:00) 

* > 

a. holding your camera properly 

b\ film speed 

c., lens* opening 

d< focus , * . 

e.^ F- stop * 

. f," shuttefc speed 

■ g. loading the camera ' - 

III. UsiQg the Camera (10:00 - 10": 30) ■ . " 

IV. Developing the Negatives .(10:30 - 12:00) * 

a. materials needed: * 

k - ^hanging bag, developing tank, can-opener, 
D-76 developer (Hf 110), stop bath, fixer, 
* scissors, funnels, graduates v thermometer 

b. . mixing the chemicals - temperature factc^r 

c. loading ^the negatives 

d. 1 developing negatives - time factpr 



RJC 



•88- 



s 



BILINGUAL PUPIL SERVICES 



DISTRICT WORKSHOP #5 



Field Instructional Specialist: Fernando Crespo 
„ Date: February 19, 1982 " „ <. 



DISTRICT 



42 



ROOM 

5th Floor 
Conference Room 



/ 



* TIME 
. ' 8';50 - 3:00 



AGENDA 



I. Group Dynamics 

II. Presentation on E.S.Lr materials 

A. Mr. David Van Dillan and Ms/ Sandra Ferguson 
Scotts Foresman ' 

» 

in - LUNCH (12:00 - 1:00) 
IV. Programatic Matters 

A. Update Schedules 

B. Update College Data Sheet 
» C. Para Notebooks up-to-dat£""~ 

D. Teacher Para Evaluations 

E. Formal Lesson Evaluations 



F. Field Instructional Specialist/Para 'Evaluation 

i 

G. § Lateness 

H. End ,of Year Activity 
V. Demonstration Lesson E.S.L. 

VI. Materials Development 

-89- 



V. How to Print Black'- and White 



a. mixing chemicalis 

b. contact sheet 

c. test stfcip 
■d. timing * 



VI. LUNCH 

- & 



(12:00 - 



1:00) 



\ 



VII".* Developing .Prints and Question and Answer Period 



BibliograpHy 



The Basic Book of Photography 
By Tom Grimm J j 

New American Library 



Julio 

Mkrta* Lopez 
Inez Fuentes 
Rosa Reyes 
Juanita Torres 



groups 



LeonoV 
Onelia 



Migdalia Ramos 



Miguel 



alloway 
3plo'n 



Sara Gonez 



>lon 



' Edgardo 

Arsenio Quinones 
Sonia Alicea 
Digno Vega 
Margarita Olivo 

/ • \ 



9 
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BILINGUAL PUPIL SERVICES 
< ' 

xr 



AGENDA 



I . Group Dynami cs -J 
II. Presentation on E.S.L. materials: 



/ • ' ' • '.. * DISTRICT WORKSHOP #5 

* * . • » 

. .. t DISTRICT SCHOOL • . , ROOM TIME. 

,.k2' ' ,< — \" 5th Floor' 8:50-?:90 

•Conf. Room 



Mr. David Van D i 1 1 an and Ms, Sandra .Ferguson - 
Scotts Foresman 



III. Lunch:.' 12:00 - 1 :00 
IV. 'Programatic Matters 
V. Demonstration Lessons 



a) E.S.L. - Miriam Moreno 

b) Spanish Reading - Marta Lopez 



9 
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BILINGUAL PUPIL SERVICES 0 



DISTRICT WORKSHOP, #5 



Field Instructional Specialist: Eugenia L. Montalvo^) 
Date: February 19, 1982 



DISTRICT ^ ' ROOM ^ TIME 

; . 

42 2nd Floor , m 9:00 - 3:00 

Conference Area 



AGENDA 



I; Group Dynamic (9:00 - 10:00) 
II. Progfamatic Matters * 

* > -A. 'Field Instructional Specialist fara Evaluation 

3. Teacher - Para Evaluation 

C. Para Notebook Up-to date 

. * p. Update - .Schedule -and # Release Time Form (A.S.A.P.) 

" E. Formal Lesson, Teacher - Para and Field Instructional 
Specialist - Para Evaluations 

F. Lateness 

G. State department of Education - Ms. Gay Wainwright-Niang 
Titlpr I Monitoring Visits 

• H. End of the Year Activity - Luncheon t v 

III. Dr. Joseph H. Rubinstein and Ms. Isabel Charres 

'Open Court Publishing Company * 

Topic: Real Hath (10:00- 12:00) 

, LUNCH . (12:00 - 1:00) 



■92- . 
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IV. Materials Development (1:00 - 2:30)- 

V. Workshop Evaluation (2:30 - 2rA0) 

VI. Distribution of Handouts (2:40^-^2:50) 

VII. March Workshop . (2:50 - 3:00) 



f . 



4 



9 
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BILINGUAL* ?U?IL SERVICES 



DISTRICT WORKSHOP =6 
# 



Field Instructional Specialist: Kir i am Moreno 

• r 

'Date: March 5, 1982 



DISTRICT 



42 



ROOM • 

2nd Floor 
Conference Area 



TIME . 



8 : 50 - 3 : 00 



.AGENDA 



t. Group Dynamics (.9:00-9:30) 
II. . Programatic Matters (9 :*30-10 : 00) 

A. Payroll Procedures ' 

B. End-of-Year Activity 
Presentation (10:00-12:30) 

A.'" Open Cou2?t Math 
LURCH (12:30-1:30) 
Material Development (1:30-3:00) 



III 
t 

IV 
V 



9 
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BILINGUAL PUPIL SERVICES 



DISTRICT WORKSHOP #6 



Field Instructional Specialist: Eugenia L. Montalvo - Silvia Buzsfonetti 
Date: March 5, .1982 



DISTRICT 



42 



ROOM 

2nd Floor 
r Conf erence. Area 



TIME . 



9:00 - 3:00 



( 



AGENDA 



\ 



I. 1 Group Dynamics Activity * (9:00 - 9U5) 
II, Programatic Matter? 



(9:15 - 9:45) 

r 



*s - 



. 1, New payroll procedures 
2. End-of-Year Aptivity 
fcll. Presentation (9-: 45 - -12:00) 

1, Using Media in the Classroom 

2, Producing Slides 

3, Producing Films trips # 

4, Synchronizing Sound 

v " 5, ' Using Polaroid Camera 
IV. LUNCH 4 (12:00 - 1:00) 

V, Materials Development (1:00 - 2:15) 
VI, Discussion of Materials (2:15 - 2:45) 
VII • Workshop Evaluation/Cleanup (2:45 - 3:00) 
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BILINGUAL* PUPIL SERVICES 



' DISTRICT WORKSHOP *6 



Field Instructional - Specialist : Fernando Crerspo 
Date: March 5 , *1982 



DISTRICT 



i+2' 



ROOM 



2nd Flodr* ^ 
Conference Area 



TIME 



8:50 - 3:00 



A 



A G. E N D A 



4 



I . Group Dynamics ( 9-: 0 0 - 9 : 30 ) • 
II. Programatic Matters (9:30-10:00) 
A. Payroli Procedures 
- B. End of. Year Activity^ 
III. ' Presentation (10:00-12:30) 
_ ^ aT Open Court Math 
IV. 'LUNCH (12:30-1:30) 
V. Materials Development (1 : 30-3 : 00) 



9 
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BILINGUAL PUPIL ■ SERVICES 



DISTRICT WORKSHOP 



; •> . - .... 

Field* Instructional Specialist: Miriam^oretfo 
Date: Aprils, 1982 ,# \ 

DISTRICT • SCHOOL ROOM TIME 

42 , — « 5th Floor 8:50-3:00 

Conf , Room 

*° * . 

AGENDA 



I. Group Dynamics — film 

II, Programatic Matters • 

S) Career training application L - April 1, 1982 
.b) Payroll due - April 7 

Checks available - April 7 
*Check will be held, if you call Mrs- Caraballo, 

by Tuesday, April ^6 



III, 



/Demonstration lessons 

♦ ' r 

• a) Creative Writing - Inez Fuentes 
b) ESL>- Leonor Galloway 



IV. LUNCH 



Materials Development 

a) Bunny Book 

b) Envelope 

c) Basket 



> 
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bilingual! pupil serviqes 



DISTRICT WORKSHOP i l l 



Field Instructional Specialist 



: (Silvia Bu22onetti A y 

Eugenia L. Montalvo 1*)?%,. 



Date:- April *2\ 1982 ( ' 

DISTRICT * £22i* N 

42 2nd'Floor 9:00 - 3:00 

Conference Area 



AGE1DA 



I, Programatic Matters (9:00 - 9:30) 

A. Career Training Application \ 
1. April 1, 1982 

B- Payroll 

1. Due April 7, 1982 - 
2- Checks available April 7, 1982 
m \ a) Checks will be held if you call 

Ms. Caraballo by Tuesday, A^ril 6, 1982 
3. State Department of Education - Ms. Gay Wainvright-Niang 
. Title I Monitoring Visit - April 5,6,7 

II • Presentation on E.S-L. Materials / » > 

A* Mr. David Van Dillan and Ms- Sandra Ferguson -^Scotts fcpresraan 

* 

III, Demonstration Lessons - E,S»L- - 

a) Ms- Eileen Partilla \ 
* b) Ms- Carmen Cardona . • 

c) Ms- Aida Resto 

IV. LUNCH- (12:30-1:30) 
V, e\s<-L.' Materials Development (1:30 - 2:45) 
■ VI: Evalul$)io?is ' ^ . 
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Bilingual pupil services 



DISTRICT WORKSHOP, f/7 



Field Instructional Specialist: Fernando Crespo 
Date: April 2, 1982 



DISTRICT 



42 



ROOM 



.., 5th Floor 
Conference Area 



TIME 



' 8:45 ~ 3:00 



X 

A G E N D" 




I. Programatic Matters ' (8:45 - 

A. Career Training Application 

1. April 1, 1982 

B. Payroll 

«* ( 

1 1. Due April, 7, 1982*. 

2, Checks available April 7, 19! 

a)" Checks will "be held if ^iu call 

Ms. Carabal-lo by Tuesday mpril 6, 1982 

Photography Workshop A.M.- Session (9:30'-12:GO*&<5n) 

* A. Presenter 

1. Mr. Stephen Fisher 

LUNCH' (12.: 00 - 1:00) 

Photography 'workshop P.M. Session (1:00 - 3:00 p.m.j^g 



II. 



III. 

• IV. 



99" 
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BILINGUAL PUPIL SERVICES 



DISTRICT WORKSHOP #8 



k r" 

' Field Instructional Specialists: -Eugenia L. Montalvo - Silvia Buzzonetti 

i Miriam Moreno - Fernando Cresp'o. 

. Date: May 7,. 1982 , . . • 



DISTRICT 



42. 



ROOM 

5th Floor 
Conference Area 



TIME ' 

> 

8:50 - 3:00 



• AGENDA 
■ « ■ 

I. Group Dynamics (8:50 - 9:15) 

II. Guest Speaker .(9:15 - 11:Q0) 

III. Programatic Matters (11:00-12:00) ^ . 

a) Teacher Evaluations due May 18 With Payroll 
by Post-testing May 11, 12, 13, Due May 20th 
c) Luncheon 

1. "OchentasV v 
2- " La Tertulia", June 4, 1982 
* di Formal Observations 

e) Final District Workshop - June U , 1982 

f ) Career Training Forms for Fall 1982 
available by* : the End of Ma^ 

IV. LUNCH ' (12:00-1:00). <- 

V. Data Retrieval Forms (1V00 - 3:00) 

a) Attendance*froms,October 14 to May 13 
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BILINGUAL PUPIL SERVICES 
Ql STRICT WORKSHOP #9 



Field Instructional Specialists: Si lvia Bu?zonetti" Eugeni a ,Montalvo 

> * Fernancjo Crespo Mi ri am^Moreno 

Data: June k ♦ N . 

DISTRICT - „ ■ ROOM JJME 

kl ' * 131 Livingston Street . 9:00 - 3:00 / 

5th Floor Conference Area 



AGENDA ' • 

't* 

I. Group Dynamics Activity' (9:00-9:30) 

II. Programmatic Matters -(9:30-10:00) 

a) Fall 1982 Career- Training Vouchers 

b) Last Payroll "dud: June, 28 ■ 

" c) Mi n\i Resource Library: Last day for returning 
materials June 25 
d) School preferences for 1982-1983 Academic Year 
* 

11,1. Data Retrieval Form^ * * 

a) Completion * v 

b) Compilation and Packaging 

,v - JL JJ N C H (12:00-1 :00) 

§ 

V. Data Retrieval Forms (1:00-3:00) 
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BILINGUAL PUPIL SERVICES 
131 Ll'V I NGSTON STREET, ROOM 512 
BROOKLYN , NEW YORK 11201 



WORKSHOP EVALUATION FORM. 



Cel ia M. Delgado 
Project Director 



TOP IC: 
SITE: 



DATE ^ 
TIMEr 



?RESEMT-ER(S) 



Please take a few moments to evauluate the workshop. This information will be 
used, in planning future workshops. Your comments and suggestions *wi1 1 be greatly 
app re'ci ated. ' • , , 

Please rate the^workshop by checking the appropriate box-at-t;he right. 



1 


, Excellent ( Goodi^Fairj Poor \ 


1. Clarity of the workshop objectives 




! " i 

! «* J* 


2. Organ izatri on of the workshop ^ • ' 

• 




t 


- i 


3. Usefulness of the information 








k. Time allote^ for questions S- clarifications 




. ! ■ i 


5. Achievement of the workshop objectives 





.1-1 


6. Overall effect i veriess of presentation 




i i 

1 i 



I would recommend this type of workshop to: Paraprofessionals , 

Teachers.,-' Supervisors, Parents, Community Persons. 



I wish the workshop had offered more 



Additional comments and/or sugg^t ions ^ for fufure workshop topics 



THANK YOU FOR YOUR C00P£RATI0N4 ' . , 

« ** 



ERIC 
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THE CITY SCHOOL DISTRICT OF NEW YORK 
131 LIVINGSTON STREET, BROOKLYN, NEW YORK 11201 
OFFICE OF BILINGUAL c EDUCATION 
BILINGUAL PUPIL SERVICES 
ROOM 512 



EVALUATION OF . MONTHLY DISTRICT WORKSHOP § 



Please complete this evaluation of the Monthly District Workshop. 
Please fill in the following: 

I 

1 ' * 

1. Ed. Associate * Ed. Assistant _ J 

v2. Grade _____ 
3 . Presentation was : 

S Excellent ; Fair : 

Good . . Poor 



4. ' The materials used and recommended^ were: 

Excellent. _ ' Fair 

Good , * ^oox 



5. VWas the workshop content relevant to your needs as a'paraprof&ssional 

* Yes Why? , 1 . : — 

* No Why? _ ■ * 

6. Was Che materials ' development session relevant to your needs as a 
paraprof essional? 



lg Yes Why 

No . Why? 



% 7r What was the most significant, aspect of die workshop? 



e'r|c . M " " - 1P3 V^ 



FCS S I SLE TOPICS fCR FUTURE WORKSHOPS 




s ' V 



| Diagnostic Testing 



Teaching English *As. A Second Language 



1 
) 


Overview of the Mathematics Curriculum 


i ' 
{ 




f 

} 

1 

1 ' 


Interpersonal Relations/S tudents ; Teacher; Parents) 

* 


< 

1 k 


• 



(,l$ec?f retuUtf i.e. P^e^C?.u+- 

' O * . >. -£-L_ • *' ' * " 104 - 



11 
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- APPENDIX D 



ERIC 



- OFFICE OF EDUCATIONAL* EVALUATION 
NEW YORK CITY PUBLIC SCHOOLS 



QUESTIONNAIRE FOR PROGRAM PARTICIPANTS 
8J LINGUAL PUPIL SERVICES 
* 1981-1982 

— \ 

1. Please indicate how Tonq you have participated ij the Bilinqual Puprl 
Services Proqram, including this academic .year (1981-82): 



yea r ( s ) ^ -months 



. ' J _ 

2. If funds- are available and you are eligible, would you like to 
participate in" the Bilingual Pupil Services Program next year? | 

yes no 

3. Please indicate the grade(s) you "have taught during academic year 
1981-82 (check all that^ apply): . 

\ : lj_ 3 4 ' 5 V_ 6 * 

4. How many college credits towards your baccalaureate degr^\(B.A. or B.S.) 
do you expect to have completed \n total by'June 1982: $' 

c redits 



During academic year 1981-82, how many college credits do' you expect 
to have completed .by June (Fall 1981 and Spring 1982). 



_c redits t- ^ , 



V.. 



£. Do you expect to be qraduated from colleqe by glimmer 1982? 

ye s n o t 

7. Do you expect to have received your teachinq license b# September 1982? « 

yes 

no 

I already have the teaching license ' * ; 



don't know 



8. Whatsis your sex? 

male female 



9. Please indicate your country of birthr 



\ 



r 
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10. If you were born in the U.S., please indicate your parents' country/ 
countries of birth. 



11. I ?m in the following age group: 

20 to 25 

26 to 30 

31 to 35' 

f *36 to 40 



_41 to- 45 
_46 to 50 
J51 to 55 
56 or over 



12. Using the following scale, please rate the followinq proqrammatic 
and administrative components of the Bilingual PupiL_Services 
Program: ' v 

l=Inadequate 2=Below Average 3=Averaqe 4=Good 5=Exoellent 

a. Accessibility to Field Instructional Specialists 

b. Adequacy of communication between program staff and 

paraprofessionals ^ . 

c. Quality of on-site training of program participants 



d. Usefulness and relevance of the monthly workshops 



e. Usefulness and relevance of weekly in-service! jtra'ining 
sessions • - I 

f. Usefulness and relevance of material in the iini 
resource center <>' " 

g. Accessibility to mi-ni resource center materials* * 



h. Acjyisement of paraprofessionals on professional and 
academic matters 

i. Follow-up by F.I.S.'s on paraprofessionals' needs 
j. Feedback by F.I.S.'s on paraprofessionals rV progress 



k. Scheduling of program activities 



\ 



1. .Overall quality of Bilingual Pupil Services Program 



i 
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13. Using the following scale, please rate the adequacy with which the 
areas listed below have -been addressed by the various training 
activities of the Bilingual Pupil Services Program: 

l=Inadequate 2=Below^verage * 3=Average ^ 4=Good 5=Excellent 

a. Lesson planning 

b. Methods of teaching reading in the bilingual classroom 

c. Methods of teaching mathematics in the bilinqual 

classroom * . ^ 

d. MethodSL of teaching E.S.L. in the bilinqual classroom • 

e. Methods of teaching language through the content areas 



f. Incorporation of the students' culture(s) within the 
instructional process 

g. Curriculum development, adaptation, and utilization 

h. Development, adaptation and utilization of instructional 
aides* * 

i. Language and academic assessment of bilingual students 



j*. Approaches for motivating students in the teaching/ 
v learninq process 

k. Keeping records of students 1 progress 



1. Grouping/individualized instruction in the bilingual 
classroom 

m. Development of personal qualities leading to effective 
teachingfin the bilingual classroom 

14* Comments: , , 



15. 'Recommendations/to improve the Bilingual Pupil Services Program: 



/ 



r 



9 
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